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A TECHNIQUE FOR MAKING EXTENSIVE 
POPULATION ESTIMATES 


Dona.p J. BoauEe 
Scripps Foundation for Research in Population Problems 
Miami University, Oxford, Ohio 


This article describes a population estimating technique 
which is designed to facilitate the study of population trends 
during postcensal periods. By using current vital statistics, 
population estimates for groupings of area are obtained which 
are sufficiently accurate to permit inferences to be made con- 
cerning growth or decline since the last census. 


HE TECHNIQUES now in use for making postcensal estimates of popu- 
lation have been designed primarily for the purpose of obtaining 
bases for computing morbidity, mortality, and natality rates of individ- 
ual cities, counties, and states. Since the agencies whose duty it is to 
prepare such calculations have, in most instances, less than 150 major 
units of area for which a population must be estimated, they are able 
to expend considerable time and effort to obtain each estimate. Special 
tabulations of census data, and data available locally, may be intro- 
duced into the computations in order to refine, check, or correct the 
results. Consequently, the making of postcensal population estimates 
has tended to be characterized by an “intensive” approach, whereby 
large amounts of labor are expended upon a small number of units of 
population to obtain successively smaller increments of accuracy.' If 
an estimate of the population of individual counties or cities is desired, it is 
imperative that one of these intensive techniques be used. Some very incor- 
rect estimates can result from the use of less meticulous methods in 
attempting to make population estimates for individual small areas. 
It is almost impossible, on the other hand, to make use of these in- 





1 See Hope T. Eldridge, “Suggested Procedures for Estimating the Current Population of Coun- 
ties,” Bureau of the Census, Population Special Reports, Series P-47, No. 4, April 30, 1947, and Henry 8. 
Shryock, The Postcensal Essimation of Population in the United States (Madison: University of Wisconsin, 
1937) Ph.D. thesis. 
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tensive methods to discover general population trends during intercen- 
sal periods. A very large amount of work would be required to prepare 
an estimate for each of the several dozen counties or cities which are 
added together to constitute one major category for trend analysis. 
Yet between one census enumeration and the next the demographer, 
the economist, and others would like to keep abreast of population 
growth trends throughout the Nation. These trends could be known ap- 
proximately if some fairly simple technique for making postcensal esti- 
mates on an “extensive” basis were available. For work of this type the 
estimator would be less concerned that the estimate for each and every 
local unit be correct than is the case in making estimates for computing 
local rates, if the swm of the estimates for several small units were rea- 
sonably accurate. During periods of high mobility and rapid growth, 
as since 1940, the desire for information concerning distributional 
trends is unusually great, and a fairly wide range of error would be 
tolerated in order to learn even approximately what changes have 
taken place since the last census. 

The following pages describe an “extensive” technique for making 
postcensal estimates by use of annual statistics of births and deaths. 
The device is a modified version of a procedure suggested by Professor 
P. K. Whelpton. A report of some major redistributional trends in the 


United States since 1940, based upon its use, is being made elsewhere.’ 


I, DESCRIPTION OF THE METHOD 


The number of births and deaths which occur each year among a 
population is roughly proportional to the size of that population. By 
means of a few statistical refinements this principle can be converted 
into a device for making postcensal population estimates. This involves 
making certain assumptions about current crude birth and death rates 
in a subarea, for which an estimate of current population is desired, in 
relation to the known or accurately estimated rates for the larger area 
of which the subarea is a part. 

In 1938 Whelpton stated these assumptions as follows: 

“While birth and death rate trends are not the same for all parts of the 
Nation, the differences between the national trend and trends for most of 
the more important areas do not become large during an intercensal period. 
Moreover, as the Hotellings have shown, there is an inverse relation between 
annual changes in birth rates and in death rates, which should tend to make 


a combination of the two series for various parts of the Nation agree more 
closely with the national trend than either series alone. Estimates of the 





2? Donald J. Bogue, “Some Changes in Population Distribution since 1940,” American Journal of 
Sociology, July, 1950. 
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population of states, large cities, groups of smaller cities, and large rural 
areas based on the assumption that the trend of the sum of the local birth 
and death rates is similar to the trend for the United States may thus com- 
pare favorably in accuracy with those obtained by other means.”* 


Thus, if in 1940 a state had a higher crude death rate than the Na- 
tion, it would also tend to have a high crude death rate relative to the 
Nation in 1949, and the extent of its deviation from the national rate 
would tend to remain about the same throughout this period. The 
reasons for this relative stability are readily apparent. In any area the. 
annual crude birth and death raies are a reflection of a more or less in- 
stitutionalized set of demographic, economic, and environmental con- 
ditions. “High,” “medium,” or “low” vital rates in any area are not 
completely matters of chance; the age-sex-color composition of the 
population, the income level, the educational level, the customs and 
system of values of the people, as well as the public health practices, in- 
fluence the crude birth and death rates. None of these factors is subject 
to extensive change in short periods of time except under unusual condi- 
tions. There may be responses to changes in economic or other social 
conditions, but these tend to have a regional or national incidence, 
rather than a purely local one. Consequently, aside from year-to-year 
fluctuations resulting from epidemics, catastrophes, and random fac- 
tors, within a decade the crude birth and death rates of a subarea tend 
to stand in a fairly constant relationship to the parent area, or tend to 
change relatively slowly. 

If this relationship between the vital rates of a subarea and the par- 
ent area were invariant, then the crude death rate (or the crude birth 
rate) of the parent area could be multiplied by a known factor to obtain 
an estimated crude rate for the subarea for any year. A very accurate 
estimate of current population could then be obtained simply by divid- 
ing the estimated rate into the number of deaths (or births) registered 
and allocated to the subarea and multiplying by 1,000. Thus, if the 
crude birth rate for an area could be estimated with complete accuracy 
to be 20 per thousand, then each infant born during a year could be 
thought of as representing 50 residents. 

In actual practice, the relationship of neither the local crude birth 
nor the local crude death rate to the corresponding rate of the larger 





2 P. K. Whelpton, Needed Population Research (Lancaster, Pennsylvania: The Science Press Print- 
ing Company, 1938) p. 15. Other demographers have made use of vital statistics to make postcensal 
estimates. Among them are E. C. Snow, “The Application of the Method of Multiple Correlation to the 
Estimation of Post-Censal Populations,” Journal of the Royal Statistical Society, 74: (1911) pp. 575-629 
and John D. Durand, whose experiments with the use of specific death rates for non-epidemic causes of 
death for making postcensal estimates are reported by Shryock, op. cit., pp. 109-113. 
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area is sufficiently stable to permit this series of inferences. Changes 
in the age structure, resulting from migration and ageing, is one of the 
principal disturbing elements. Over a period of ten years these two fac- 
tors can alter the age composition to such an extent that an estimate 
based upon deaths (or births) alone would tend to become progressively 
biased. The resulting error tends to be too large to permit an estimate 
based on births or deaths alone to be used. Fortunately, ageing and a 
change in the rate of net migration tend to have the opposite effect 
upon the crude birth rate that they have upon the crude death rate. A 
large proportion of migrants are in the most reproductive years of life. 
At these years the likelihood of death is smaller than for the general 
population. An unusually large influx of migrants would therefore tend 
to lower the crude death rate and to raise the crude birth rate; an un- 
usually large exodus would tend to have the reverse effects. In both 
cases, the change in the birth rate would tend to cancel the change in 
the death rate. As a population ages and enters those years where the 
probability of dying is greater, it becomes less exposed to the prob- 
ability of reprod‘ng. It is because of this tendency for a change in 
age composition to cause opposite responses in the birth and death 
rates that Whelpton suggested using the sum of the subarea crude 
birth and death rates, in relation to the sum of these rates for the 
parent area, for making population estimates. 

During the period for which Whelpton made tests of the accuracy of 
his suggested technique, birth rates and death rates were both falling. 
From 1920-30 the crude death rate of the registration area fell 13 per 
cent, and the crude birth rate fell 25 per cent. Since birth rates would be 
more sensitive to changes in the younger (migration) age groups than 
death rates, the trend of the sum of birth and death rates yields fairly 
satisfactory results for the period 1920-40. By way of contrast, dur- 
ing the war and postwar years (1940-47) the crude death rate decreased 
by 5.3 per cent and the crude birth rate increased by 47.9 per cent. A 
trend based upon the sum of these rates gives far more weight to fluc- 
tuations in births than to fluctuations in deaths. There is considerable 
evidence that there are sharp geographic differentials in the intensity 
of the “baby boom,” and that these differentials are related to several 
factors other than the long-time trend in natality rates. In other words, 
the deflection of birth rates during the postwar years from their prewar 
trend is in part a response to factors which are unique, and which are 
not fully covered by the assumptions made above. Birth rates are 
therefore not as adequate as a corrective factor to change in age com- 
position as before the war, and less weight should be placed upon the 
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birth statistics than in Whelpton’s proposal. In order to obtain reliable 
estimates of population, using current birth statistics, it is necessary 
to make some additional assumptions about how crude birth and death 
rates have behaved, in relation to their prewar status. 

The assumed relationship between the vital rates of the subarea and 
of the parent area may be quantitatively expressed in several ways. 
When the rates of the parent area are falling, the ratio of the rate of the 
subarea to the rate of the parent area is undoubtedly the most useful 
simple expression of the relationship, for it takes some account of the 
observable fact that birth and death rates for subareas with higher 
than average birth or death rates tend to decline by more points in a 
given period of time than the birth and death rates of subareas with 
lower than average vital rates, for in order to maintain a constant ratio 
to a declining index, a large number must lose more points than a small 
one. If the crude rates are rising, however, the “constant ratio” assump- 
tion becomes a less realistic expression for relating rates of subareas to 
rates of the parent area, for under such conditions, the subarea with the 
higher than average ratio is assumed to increase by more points than 
the subarea with a lower than average ratio. Hence the use of the ratio 
of the birth-dominated sum of the vital rates to make population esti- 
mates in the postwar period of rising birth rates assumes that the great- 
est increase in birth rates has taken place in those areas which already 
had the highest birth rates, and that the smallest increase has taken 
place in areas where birth rates have previously been lowest. The small 
amount of specific evidence available indicates that the reverse is true. 

A comparison of the 1939-40 ratios of the birth rates of states to the 
birth rate of the Nation with the same ratio for 1947 (based upon Bu- 
reau of the Census population estimates for the states) reveals that the 
states with higher than average ratios in 1940 have tended to lose ratio 
points and the states with lower than average ratios in 1940 have 
tended to gain ratio points. In fact, the extent of this tendency to move 
closer to the national birth rate is in part a function of the amount of 
divergence from the average in 1940. The least squares regression of 
the birth ratio of the states, 1939-40 average, on the change-in-birth 
ratio, 1940 to 1947, is fairly steep. The scatter of the states from this 
regression line is surprisingly small (r= —.74, P less than 0.1).5 





4 y= —0.315z +0.325, where y is the estimated change in ratio between 1940 and 1947, and where z 
is the actual ratio of the state to the national rate in 1940. 

5 A similar, though much less clear-cut, situation exists for the trend of death ratios of states since 
1940. The slope of the least squares regression lines is very steep because a very few states with ratios 
only moderately in excess of 1.0 made great strides in reducing their crude rates. There is considerable 
deviation from the trend, however (r = —.39 P, less than 0.1). 
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Thus, in devising a procedure for making postwar vital statistics 
estimates, it is necessary not only to give less weight to birth data than 
formerly, but also to relate the birth rates of subareas to the birth rate 
of the parent areas by an expression which acknowledges the tendency 
for the rates to converge toward the average rate during the period of 
their rapid rise. This may be accomplished by giving equal weight to 
the birth and death data, and by using ratios of the vital rates of the 
subarea to the vital rates of the parent area which have been corrected 
(if deemed necessary) for change-in-ratio as a result of deviation from 
unity in 1939-40. 

In making estimates of the population of local areas for 1947 (the 
latest year for which Federal Vital Statistics are available) it has been 
assumed that the regression equation of change-in-ratio of birth rates 
of states, given above, is an approximate expression of necessary cor- 
rection in 1947 for any subarea whose birth rate deviated from the 
birth rate of its parent areas in 1939-40. The death ratios of 1939-40 
have been assumed to be valid in postwar years. 

The sequence of steps involved in making a vital statistics postcensal 
estimate on this basis is as follows: 


a. Compute crude birth and death rates (1939-40 average or other 
two-year base around a census year) for the subarea and for 
the parent area. 

. Express the crude death rate of the subarea as a ratio of the 
crude death rate of the parent area. Make the same computation 
for the birth rate. 

. Make an independent investigation of how the crude birth 
rates and crude death rates of the various subareas have be- 
haved in the recent past in relation to the trend of vital rates 
in the parent area. If a definite change-of-ratio with the passing 
of time is indicated for any class of subareas, devise a set of 
correction factors to be applied to the ratios for the base year 
in order to obtain “corrected” ratios for the year of the esti- 
mate.® 

d. Compute a crude birth and crude death rate for the parent area 





6 At the present time, the details of this step must await further research until after the 1950 Census. 
At that time the behavior of crude rates in relation to the rates of larger areas can be studied in detail, 
for a full decade of vital statistics tabulated by place of residence preceded and followed by a census, will 
be available. The “corrections” suggested above for birth ratios for 1947 are admittedly only makeshift 
factors which have been introduced in the absence of better data. Similar corrections for trends-in-ratio 
must exist for death rates, and could be isolated and introduced. If no correction factors are introduced, 
then a method of adding a “constant difference” instead of multiplying by a “constant ratio” should be 
used in step “e” whenever a vital rate for the parent area rises above the rate for the base (last census) 
year. 





POPULATION ESTIMATES 155 


for the year for which a population estimate is desired. (Choose 
as a parent area a state or other unit for which the Bureau of the 
Census makes a regular postcensal estimate. The Bureau of the 
Census estimate can be used as a base to compute the vital 
rates for the parent area.) 

. Multiply the crude death rates for the parent area obtained in 
“d” by the corrected death ratio of the subarea obtained in “c” 
to obtain an estimated crude death rate for the subarea. Repeat 
for births. 

. Divide the estimated crude death rate of each subarea into the 
number of deaths registered for the year and allocated to resi- 
dents of the subarea. Repeat for births. This yields two estimates 
of the subarea population, one based upon death and one based 
upon birth data. 

. Average the two estimates to obtain a single population esti- 
mate. 

. Adjust the population of all subareas to equal the total popula- 
tion of the parent area. This yields an estimate for the population 
as of July 1 of the year for which the rates have been computed. 


The suggestion that the two estimates be averaged is only a practical 
rule arrived at by trial. In reality the estimating procedure is very 
flexible at this point; the estimator may combine the population esti- 
mates based on births and deaths in any combination which he believes 
will yield the least average error. The weights given can vary with the 
estimate of reliability and completeness of each series of data, with the 
type of population, or for other reasons known locally. Before balanc- 
ing the sum of the estimates for individual areas to the total of the 
parent area he can review the pair of birth and death estimates for each 
subarea, noting obvious errors which one would expect to result from 
using the birth statistics of such cities as Beverly Hills, California, or of 
Leavenworth County, Kansas, and correcting them by assuming the 
death estimate to be biased in the direction and by the amount indi- 
cated in acceptable estimates for other similar areas. Similar estimates 
from birth data alone may be made for areas whose estimated rates 
appear to be in serious error. If separate estimates are made for cities of 
10,000 or more and the remainder of the counties containing such cities, 
one should assume that the estimate for the cities for the years 1945-50 
is about 2.0 per cent too high (see Section II). This amount should be 
added to the “remainder” of the county and the parts of the county 
balanced to the county total obtained by steps “a” through “g” above. 

All ratios, rates, and birth and death data should be taken from tabu- 
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lations by place of residence. If only a very few areas are to fall within 
each grouping for which a current population figure is desired, it is ad- 
visable to make an estimate for each year from the year of the last cen- 
sus to the date of the estimate, and to smooth out unusual year-to-year 
fluctuations. 

Although the above procedure may be made to yield an estimate for 
every county and every city of 10,000 or more inhabitants in the United 
States, in most instances there will be some units within each state 
which are grossly overestimated or underestimated. Local epidemics or 
disasters, annexations, changes in the completeness of registration and 
in accuracy of residence allocation, change in the sex or ethnic compo- 
sition by migration, increases or decreases in the proportion of institu- 
tionalized population, the comparative adequacy of the vital statistics 
for the base year and for subsequent years, and other factors can oper- 
ate to cause an error in either the birth estimate, the death estimate, or 
both. Moreover, the correction of the ratios for clustering or other 
trends is only an over-all average from which the individual area may 
deviate considerably. For these reasons, although the sum of estimates 
for several individual areas will be correct within fairly narrow limits of 
error, the estimate for single areas should be used with extreme caution. 
The smaller the population for which an estimate is prepared by this 
method, the more likely it is to be in error. The vital statistics technique 
is useful primarily for discovering population trends; it is not a 
cheap way of escaping the labor involved in estimating individual local 
populations accurately.’ For studying population trends, the estimates 
for 15-20 subareas (cities or counties) should be contained in each total, 
unless the subarea units are very large. For smaller units an even larger 
number of subareas for each total is desirable. 


II. RELIABILITY OF THE ESTIMATES 


The usual test of an estimating technique of this type is to measure 
its ability to approximate the results of a census, using only data that 
would have been available had the estimate been made before the cen- 
sus was taken. Since the estimating device which has been described 
makes use of vital statistics data tabulated by place of residence, and 
since data of this type are not available for 1930-34, a rigorous test of 
the reliability of this estimating procedure cannot be made until after 
1950. Not until then will it be possible to estimate the population of 
cities and counties as of a census year, using ratios based upon statistics 





7 These estimates assume, of course, that the census estimates of state populations are correct. Er- 
rors in the census estimate will produce a corresponding error in the local estimate. 
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of births and deaths to the resident population during a preceding 
census year. Meanwhile, rough tests can be performed by comparing 
the vital statistics estimates for states with the enumerated state popu- 
lation, and with populations estimated on another basis, and by com- 
paring the vital statistics estimates for counties and cities with the re- 
sults of state censuses for 1945 in states where such censuses were taken. 


TABLE 1 


PERCENTAGE DIFFERENCE BETWEEN THE POPULATION OF STATES AS 
ESTIMATED BY THE VITAL STATISTICS TECHNIQUE AND AN 
OFFICIAL ENUMERATION OR ESTIMATE, 1940 AND 1947 
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* The population of states in 1940 was estimated by applying the ratios of vital rates in 1930 to 
the 1940 vital rates of the Nation based on the April 1 count. Birth rates and birth data were corrected 


for underregistration. Texas and South Dakota not included. Percentages based upon 1940 census fig- 
ures. 


+ The population of states in 1947 was estimated by assuming a constant difference between the 
birth rate of the states and of the Nation, 1940-47, and a constant ratio for death rates. Births and birth 


rates were not corrected for underregistration. Percentages based upon official Census estimate of state 
populations as of July 1, 1947. 


Table 1 reports the percentage of error resulting from attempting to 
estimate the population of each of the nine geographic divisions in 1940 
by using the vital statistics of 1930 and 1940. Because of the marked 
improvement in completeness of registration in some states during this 
period, the birth data are corrected for underregistration in both 1930 
and 1940.° It was assumed that the ratic of the rates of each state to the 
national rate remained constant throughout the period. The average 
error per state (neglecting signs) is 4.9 per cent and the average error 
per division (neglecting signs) is only 3.3 per cent. This table also re- 


8 See Forest E. Linder and Robert D. Grove, Vital Statistics Rates in the United States, 1900-1940, 
Bureau of the Census, 1943, pp. 98-101. 
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TABLE 2 
PERCENTAGE DIFFERENCE BETWEEN VITAL STATISTICS ESTIMATES OF THE 
POPULATION OF CITIES AND COUNTIES IN THREE STATES AND 
STATE CENSUS ENUMERATION OF THE SAME PLACES, 1945* 








Counties classified by Total 
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Difference of sums 
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OUTSIDE CITIES 
25 ,000—-over is 0 13.1 
10 ,000—24 , 999 .4 16.4 





Number of units 
ALL COUNTIES 105 
25 ,000—-over 4 
10 ,000—24 , 999 15 
5,000— 9,999 ll 
2,500— 4,999 21 
No city 


ALL CITIES 
50 ,000-over 
25 ,000—49 , 999 
10 ,000—24 , 999 12 











* Estimate made by assuming a constant difference between the birth rates of the cities and coun- 
ties and of the state, and a constant ratio for deaths. Estimates have been adjusted to the date of the 
state census by interpolating between the adjacent July 1 estimates. State census figures have been mul- 
tiplied by a ratio which yields the same total population for the state as estimated by the Bureau of the 
Census. 

+ Estimates are reported for entire counties (‘‘All Counties’’), for cities of 10,000 inhabitants or 
more in 1940 (‘‘All Cities’’), and for the portion of the counties lying outside cities of 10,000 or more 
(‘Outside Cities’). 
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ports the results of a similar estimate of the 1947 population using the 
vital statistics and rates for 1939-40 (average) and 1947.° In view of 
the rising birth rates for this period, a constant difference between the 
state and national birth rates was assumed, but a constant ratio was 
assumed for death rates. Here the comparison is with the population of 
each state as estimated by the Census Bureau.’® The average differ- 
ence per state is 3.6 per cent and the average difference per division is 1.8 
per cent. The average error per state in the above estimates compares 
very favorably with a similar error of 4.2 per cent reported by Shryock 
for state estimates of 1930 population using school enrollment data." 
The average error per division indicates that even this error can be 
halved by only a moderate amount of grouping. 

The reliability of this technique for estimating the population of 
groupings of cities and counties may be roughly determined by com- 
paring the results of its use with state censuses taken in Massachusetts, 
Kansas, and Florida in 1945 (Table 2). The population of those counties 
in Massachusetts which contained a city of 25,000 inhabitants or more 
in 1940 is estimated with an error of less than 0.1 per cent.!? A similar 
grouping of counties in Kansas is estimated with an error of —1.8 per 
cent and of Florida of 3.0 per cent. An estimate of the population of all 
cities over 10,000 inhabitants in Massachusetts differs from the ad- 
justed state census by 2.4 per cent, with a corresponding difference of 
2.6 per cent of Kansas cities and 2.1 per cent for Florida cities.1* The 
small error of the totals of the three states, where the number of cases 
in each cell is fairly large, indicates that by grouping the estimates for 
individual units fairly accurate estimates can be made of major popula- 
tion trends." 





* I am greatly indebted to the National Office of Vital Statistics for a listing of the number of births 
and deaths for the year 1947 by state, county, and city. 

10 As reported in Current Population Reports, Population Estimates, Series P-25, No. 12, August 9, 
1948. 

" Henry 8. Shryock, Jr., op. cit. See also Henry 8S. Shryock, Jr., and Norman Lawrence, “The Cur- 
rent Status of State and Local Population Estimates in the Census Bureau,” Journal of the American 
Statistical Association, June, 1949, Table I, for additional standards for comparison. 

12 For making these comparisons, the state census figures all have been arbitrarily lowered by a per- 
centage which gives the same total population for the state as estimated by the United States Census in 
Special Population Report Series P-26, No. 12, dated August 9, 1948, an interpolation being performed to 
obtain a census estimate as of the date of the state census. The vital statistics estimates have been ad- 
justed to the date of the state census by interpolating between the estimates for the adjacent July 1 
estimates. The same estimating procedure as that for obtaining the 1947 estimates of the state popula- 
tion was used. 

13 It will be noted that the groupings with fairly large errors contain only a few units. 

4 Although the above series of steps may seem somewhat long for a “simple” technique, in compari- 
son with the more refined methods the labor saved is extremely great. Each step is subject to “mass 
production,” and requires little time. It would require about 100 man days of computing to obtain esti- 
mates for each of the 155 city, county, and part-of-county outside city units for the state of Kansas alone, 
using Census methods. This does not provide for checking by a second computation. Vital statistics esti- 
mates for each of these units could be made, checked, and grouped into four desired sets of categories in 
about 5 man days. 
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That this technique is biased in the direction of overestimating the 
population of cities is evident from the fact that in all three states the 
error for cities is positive and about equal, and that the error for that 
portion of the county lying outside cities of 10,000 or more is negative. 
It is suggested that the sum of the estimates for a grouping of urban 
places be reduced by an arbitrary 2.0 per cent, that amount being added 
to the areas outside such cities but in the same counties. Since 1945 
was an early year of the boom in births, this is probably a conservative 
deduction from the estimated growth of cities for later years. Caution 
must be used in interpreting the comparative growth of cities and their 
suburbs, however, for it is this type of comparison which is most sub- 
ject to error. 

A third test of the reliability of this technique has been made by com- 
paring the estimates for 55 cities in California with special censuses 
taken at various dates during the war years."® From 1940 to the date of 
the special census, the combined population of these places had grown 
by 32.0 per cent. The relocation of the Japanese from the Pacific Coast, 
the military status of much of the resident population, annexations to 
cities, and difficulties of enumerating either a de facto or a de jure popu- 
lation, much of which was living in temporary and mobile houses, as well 
as this unusually large population growth, tends to vitiate the 1939-40 
birth and death ratios. In spite of these great changes, the sum of the 
vital statistics estimates'® for all 55 places deviates from the Bureau of 
the Census figures by only 5.9 per cent, or by only 3.9 per cent when al- 
lowance is made for the known 2.0 per cent bias toward overestimating 
urban populations. The average error per estimate was 11.5 per cent. 
Thus the device may be made to yield general information even in areas 
of very great population upheaval and change. 


Ill. APPLICATIONS AND REFINEMENT OF THE TECHNIQUE 


To illustrate how this device may be used for studying population dis- 
tribution during postcensal years, Table 3 presents the estimated per 
cent of population change in an urban-rural grouping of cities and 
counties in the Middle Atlantic Division, 1940-47. While exact com- 
parisons with earlier decades cannot be made because of the inevitable 
range of estimating error, the following facts seem fairly certain about 





15 The vital statistical estimates have been adjusted to the date of the special census by interpolating 
between adjacent July 1 estimates. 

16 These computations were made at an early stage in the experimentation with vital statistics esti- 
mates. It was assumed that a constant ratio existed between the rates of the subarea and the parent area. 
It is almost certain that 2 smaller error would have resulted if a constant difference had been assumed 
for birth rates instead of the constant ratio. 








——~ 
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population trends in the Middle Atlantic Division, 1940-47: 


1. Rapid population growth was confined primarily to metropoli- 
tan areas. 

2. The only type of area in the Middle Atlantic Division which 
grew as rapidly as the Nation was the rings of large metropoli- 
tan areas. All other types of area in the division grew more 
slowly than the Nation. 


TABLE 3 


POPULATION TRENDS IN THE MIDDLE ATLANTIC DIVISION. PERCENTAGE 
CHANGE SINCE THE PRECEDING CENSUS OF THE POPULATION OF 
METROPOLITAN AND NONMETROPOLITAN AREAS, 1920-30, 

1930-40, AND 1940-47 (ESTIMATED) 

















Per cent change 
Area 
1920-30 1930-40 1940-47* 

United States 16.1 7.2 8.9 
Middle Atlantic Division 18.0 4.9 6.4 
Metropolitan areast 21.6 6.2 7.6 
Larget 23.4 5.7 7.8 
Central cities 18.3 5.0 2.9 
Rings 32.1 6.9 15.1 
Small § 13.9 2.9 6.6 
Central cities 11.7 -0.1 7.8 
Rings 16.1 5.8 5.4 
Nonmetropolitan areas|| 6.9 3.6 2.7 

Counties containing cities # 
25,000 or more 10.3 3.0 3.3 
10 ,000-—24 , 999 6.0 3.2 2.3 
5,000- 9,999 2.0 3.4 —0.2 
Places less than 5,000 1.7 7.0 —1.0 








* Population in 1947 of metropolitan and nonmetropolitan areas, and parts thereof, estimated by 
vital statistics technique. Urban estimates were reduced by 2.0 per cent to allow for estimating bias. 

+ As listed in Standard Metropolitan Area Definition, Bureau of the Budget, January 28, 1949. 
Altoona, Johnstown, Atlantic City, which were Metropolitan Districts in 1940, were not included. 

t Counties comprising New York-Northeastern New Jersey, Philadelphia-Camden, Pittsburgh 
and Buffalo metropolitan areas. 

§ Counties comprising Albany-Schenectady-Troy, Allentown-Bethlehem-Easton, Binghamton, 
Erie, Harrisburg, Lancaster, Reading, Rochester, Scranton, Syracuse, Trenton, Utica-Rome, Wilkes- 
Barre, Wilmington (part in New Jersey), York, and Youngstown (part in Pennsylvania) metropolitan 
areas. 

|| Remainder of counties in New York, New Jersey, and Pennsylvania. 

# As of Sixteenth Census, 1940. Refers to size of largest city contained in each county. 


3. The central cities of small metropolitan areas continued to 
grow rapidly; central cities of large metropolitan areas grew 
only at about one-half the divisional rate. 

4. The vast areas outside metropolitan areas made only a very 

small growth. Those counties which contained no city or only 
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a city of Jess than 10,000 inhabitants made no population gains 
or at most only a very small gain. Counties containing cities of 
10,000 or more grew at about the same rate as the central cities 
of large metropolitan centers. 


A comparisen of these changes with the corresponding changes of 
1920-30 and 1930-40 reveals that the war and postwar years have 
neither restored the period of rapid central city growth which charac- 
terized the 1920’s nor favored the growth of nonmetropolitan areas to 
the extent of the 1930’s. The drift toward the metropolitan area has 
been accelerated over the depression ’30’s, but the acceleration has 
benefited the smaller central cities and the rings of the large central 
cities more than the large metropolises themselves. 

This method of estimating postcensal populations also has a limited 
use for estimating the population of individual cities and counties. 
Since it involves a completely different set of assumptions than those 
of other techniques, it may be used to check the reasonableness of 
estimates obtained by other methods. Extreme deviations from esti- 
mates made on another basis must be explained either in terms of 
changes in crude vital processes or as an error in estimating by the 
other procedure. Vital statistics estimates for groups of cities or coun- 
ties should check fairly closely with estimates for the same groupings 
made by other procedures. 

This technique also has a potentially valuable use for making inter- 
censal estimates. A smoothed curve of growth, estimated by assuming a 
uniform rate of change in birth and “sath ratios between two censuses 
should give a very accurate estimate of the population of individual 
cities and counties for each year during a decade. 

Since estimates of population change are subject to a much larger 
percentage error than estimates of population numbers, the “per cent 
change since last Census” rates which are computed from the vital 
statistics estimates should be interpreted with great caution. Only rates 
of change for very large aggregates which have been obtained by adding 
many smaller units should be interpreted as being accurate within a 
few percentage points. Although at present there is no way of determin- 
ing the relative ability of this technique to measure the rate of popula- 
tion change, the tests of general reliability which have been made indi- 
cate that the device will measure rate of change of large combined 
populations with at least as much accuracy as the “intensive” methods 
of estimating measure the rate of change of the population of individual 
counties and cities. 

Estimates by the vital statistics technique are of smaller potential 
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value to Public Health Departments than to other agencies because of 
the element of circular reasoning involved in using such estimates for 
rate computing purposes. This, as well as the fact that the various 
correction factors which may be introduced are broad trends and aver- 
ages which may or may not apply to specific areas, makes it useable to 
public health units only for comparison purposes. This technique is 
submitted solely as a partial solution to the “feast or famine” situation 
which exists in the study of population trends. 


AutHoR’s Nore: This study is one of several being conducted in a program 
of research on the subject of population distribution, a portion of the funds for 
which have been granted by the Rockefeller Foundation. I wish to acknowledge 
with gratitude the invaluable assistance of Mrs. Ruth W. Smith, Miss Sarah 
Frye, and Mrs. Virginia Snyder in carrying out the rather large amount of statis- 
tical experimentation necessary to complete the study. 





ARE THERE TWO REGRESSIONS? 


JoserH Berkson, M.D., D.Sc. 


Division of Biometry and Medical Statistics, 
Mayo Clinic, Rochester, Minnesota 


If, in sampling from an existent population, we wish to 
know the regression of u on », a line is fitted by least squares, 
minimizing the sum of the squared residuals of v (or y). If 
there is no error in measuring the independent variate wu, re- 
gardless of whether the dependent variate has been measured 
without error as v or with error as y, the regression is an esti- 
mate of the true regression. If, however, the independent 
variate is measured with error in z, the regression obtained is a 
biassed one. The bias will characterize the fitted line, and will 
be present whether the sample is a random one of the entire 
population or has been taken at preassigned selected values 
of z. 

If, however, the experiment is one in which one of the 
variates is a controlled observation, it differs from sampling 
from an existent population in that, 1), the line estimated by 
least squares, minimizing the sum of the squared residuals of 
the dependent uncontrolled variate, is the same, whether z or 
y is the controlled variate, that is, there is only one regression; 
and 2), the estimated line is not biassed by the existence of an 
error of observation in the independent controlled variate, de- 
spite our taking no account of it in the least squares fit. 


HIS NOTE is offered to help resolve a perplexity that has bothered 

me for a long time. Having absorbed with my statistical mother’s 
milk the idea that, for related measures x and y, there are two regres- 
sions, one for predicting y from 2, the other for predicting x from y, I 
encountered situations in practice in which the rule did not seem to 
work. Intuition and “common sense” suggested the fitting of regres- 
sions that, on the face of it, did not comply with the general rule, nor 
with any substitute rule that I had formulated for myself from this or 
that previous example. The question apparently also has interested 
others [1] [2] [3], and recently Winsor [4] has drawn attention to the 
problem in an interesting article pointedly entitled “Which Regres- 
sion?” 

The idea that there are two regressions is a teaching of elementary 
statistics. In the linear case it is usually presented in connection with 
the Pearsonian correlation coefficient, and the well-known formulas are 
given to show that the two regressions become identical only when the 
correlation coefficient is unity. The y predicting line is estimated by 
minimizing the sum of the squared residuals of y, the x predicting line 
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by minimizing the sum of the squared residuals of x. The principle is 
considered to be applicable to all measures x and y which are related, 
including those related in a physical law, as illustrated in the following 
quotation from Yule and Kendall’s textbook [5]. 
“Which of the two forms we choose will depend on a variety of circumstances 
... the choice is dictated by the purpose in view. For instance, in expressing 
the relationship between current and resistance in an electric circuit, an 
investigator would probably take as the independent variable that factor 


over which he had direct control. Frequently, however, there is no guide of 
this kind and it is necessary to ascertain both curves.” 


The implication appears clear; there are two regressions, though 
sometimes it may be difficult to decide which is appropriate. In any 
case the choice is determined by the “purpose in view,” that is, whether 
y or x is the quantity to be predicted. 

This, on the face of it, does not reflect the attitude of the physicist, 
who, if he recognizes a physical law connecting two quantities expressi- 
ble as an equation, uses this equation whichever is the dependent 
measure. An explanation of the neglect in natural science of the duality 
of the regressions is sometimes offered in the argument that with physi- 
‘al measures, as distinguished from biologic or sociologic ones, the 
errors are small, the correlation is very high, and the difference between 
the two regressions is therefore negligible. Anticipating what is to fol- 
low, I may remark that one of my earliest puzzlements regarding the 
present problem was due to my suspicions respecting the adequacy of 
this explanation. While it is true that with physical measures the corre- 
lation coefficient is frequently very high, compared with correlations 
for biologic measures, it is still sufficiently less than unity to make a 
difference in regressions that would be important in physical investiga- 
tions. 

We are dealing with measures whose “true” values are represented 
by wu and v, measured with respective errors d and e as x=u+d and 
y=v+e. For purposes of what follows, it is desirable to be somewhat 
more explicit than usual about what is meant by the errors, d and e. 
Operational meaning is given to the “true” values, wu and v, by the 
availability of instruments with which we can measure the quantities 
represented, with so very small an error that it is negligible compared 
with other instruments that yield the measures z and y.! 





1 By an “instrument” is meant not only the physical apparatus used, but the whole complex of 
setup and methods employed in making the determinations. We are not concerned here with the pro- 
found questions brought into focus by modern physics as to whether the properties of any physical ob- 
ject such as its mass or length can be, under any circumstances, considered absolutely constant, or such 
questions as arise in connection with the principle of indeterminacy. The errors referred to here are 
large-order differences of the instrumental determinations from other measurements which are com- 
paratively stable and which, for the purposes in hand, are considered to be correct. 
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I shall distinguish between two kinds of readings: (1) an “uncon- 
trolled” observation and (2) a “controlled” observation. An “uncon- 
trolled” observation is made when, wishing to ascertain the value of 
some unknown quantity u,, we measure it with an instrument. Exam- 
ples are a quantitative chemical analysis when some residual material 
is weighed with a chemical balance, or in a physical experiment requir- 
ing the length of an optical image the length is measured with a mi- 


TABLE 1 


SCHEMA OF UNCONTROLLED AND CONTROLLED OBSERVATIONS 
A. Uncontrolled observation z 














Observation Number 
Measure 
1 | 2 es, (aavavatacstaakatsier n 
Uu Us Us nn Coca aaa aa a a aa Uy 
d d, d, d; were re ee ee d, 
z=u+d Zi | Zi.2 BEG feocccccccccce Lin 

















Error d: unbiassed, s.d. =a. 
E(z from n observations, with u =u;) = uj. 


B. Controlled observation z 














Observation Number 
Measure 
1 2 - Bessacnteean n 
z zi Xs nn Sees a ee aera a a Zs 
d d, dz Mee Pesci eaceaccivece dy 
u=z—d Ui Ui .2 UHE8 fe cccccccccee Uisn 




















Error d: unbiassed, s.d. =o'g. 
E(a@ from n observations, with z =z;) =2;. 


crometer, or when the time required for a gas to pass through an 
aperture is measured with a stop watch. It is a reading ordinarily 
thought of merely as an “observation.” Suppose that, in a situation in 
which we are making an “uncontrolled” observation of weight, we 
measure a weight whose value we do not know. The true unknown 
value is u,;, but an error d; is made so it is read as 2;,,;=u;+d). We re- 
peat the weighing and now an error d: is made, so it is read as 
2;,2=U;+d2. The procedure of repetition results in a series represented 
as in Table 1A. In the series 1A, the value wu is a fixed quantity while z 
is a variable quantity. The error d is assumed as independent of u, and 
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an observation x will be considered to be measured with unbiassed 
error if, for such a series of repeated readings, the mean of the errors d 
tends to zero; the standard deviation of d is oa; 0,2? =0,?+04?. 

For an uncontrolled observation with unbiassed error 


E(zé from n observations, with u = u;) = uy (1) 


where < is mean x from n observations and E(z) is the value approached 
by the average of the z’s for r repeated experiments as r—> ©. 

A “controlled” observation is one made when, instead of wanting to 
know the value of some unknown u;, we wish to bring the quantity toa 
value u;. Examples are a quantitative chemical analysis in which it is 
required to add specified weights of a test material to a solution, or in a 
physical experiment a part of the instrument is required to be of speci- 
fied length, or a particular process is to be continued for a specified 
time. An example pertinent for the present discussion is the “bio-assay” 
experiment in which the organisms are exposed to increasing specified 
concentrations of the substance to be assayed. Each concentration may 
be made up by adding to a volume of diluent, let us say measured ac- 
curately, a specified weight of the material to be assayed, the latter 
being measured as x with error, and the increasing concentrations being 
made up by adding increasing weights. Consider the concentration 
made up by adding the weight measured as z;. In making the reading 
z;, an error d, has been introduced, so, if we reweigh it with a true 
instrument, we find it to be u;,,=2;—d,. We repeat the entire operation, 
weighing out a new amount to the same measure read as 2;; we re- 
measure this with a true instrument. In the second weighing of z;, an 
error d; has been made and, on reweighing the quantity with a true 
instrument, it is found to be u;,2.=2;—ds. A series of observations made 
in this way will appear as represented in Table 1B. In the series 1B, it 
is the value x which is a fixed quantity, while u is the variable quantity 
so that w=2x—d. The error d is assumed as independent of zx, and, as 
before, the observation x will be considered to be measured with un- 
biassed error if, for such a series of repeated readings, the mean of the 
errors d tends to zero; o’a is the standard deviation of d when z is 
measured as a controlled observation. 

For a controlled observation with unbiassed error 


E(a from n observations, with x = 2;) = 2; (2) 


where @ is mean u from n observations and E(%) is the value ap- 
proached by the average of the a@’s for r repeated experiments as ro. 
The equation (2), stating that, with error d unbiassed, the mean of 
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the true values that correspond to repeated readings of any specified 
value of =z; is in the long run the controlled value z;, is central to 
the development that follows. It is important to note that it holds only 
for a controlled observation of x. In the series which defines the error 
of the uncontrolled observation, the mean of the true values of u for 
any selected x=; will in general not be z;; the mean will depend on 
what is the value of the u; which is being measured, and, if a population 
of w’s is being measured, it will depend on the distribution of the values 
of u in that population. Conversely, relation (1) does not hold for a 
controlled observation z, for, in the series defining the controlled ob- 
servation of z=2;, the mean of z for a value of w=u; will be z;, not u;, 
unless by chance u; happens to be equal to 2;. 

The discussion of the measures u and zx applies to the measures v 
and y, with e, o, and o’, replacing d, og and o’4. 


Exactly how closely measurements, as actually made, fulfill the definitions 
for unbiassed error is hard to say. Didactic texts speak of “systematic” and 
“random” errors without clear definition. An operational interpretation of a 
“systematic” error of amount D is the finding, for a large series of the 
measurements, that the mean of the errors d is not zero but D. Calibration of 
an instrument-tends to render the error unbiassed, and this is true for con- 
trolled as well as uncontrolled observations. For instance, a volumetric 
pipet, scratch-marked to deliver the volume uj, is calibrated by delivering 
a volume in the exact manner in which the pipet will be used in practice, and 
determining the volume by accurate weighing as uw. This is repeated and a 
value uz is obtained. The procedure is continued, to establish a mean value 
a; considered sufficiently stable fr the purpose in hand, and the pipet vol- 
ume is revised as of this calibrated value a;. If the apparatus carries a graded 
scale, and is to be used for the delivery of any desired amount within the 
range of the scale, as a buret may be used, calibration is accomplished at 
successive values of the scale marks at not too large intervals; the values are 
smoothed and the resulting “calibration curve’’ is used for the delivery of 
any volume desired. 

An apparatus that is used for both uncontrolled and controlled observa- 
tions, as a weighing balance or a buret may be used, if it is calibrated for the 
one type of observation, say uncontrolled, will not necessarily be calibrated 
for the other type, since the procedures involved in the one may include 
sources of bias not involved in the other. Under these circumstances, the 
calibration must be carried out independently for each type of observation. 
On the other hand, not infrequenly the chief sources that bias the error of 
the apparatus are common to both, so that in practice a calibration curve 
constructed for one type of observation is used also for the other. Even when 
this last is practically satisfactory so far as removing bias from the measure- 
ment is concerned, if it is of some pertinency to determine the size of the 
error, then almost certainly it will be necessary to obtain this from a series 
of readings made in exactly the manner for which the measure of error is 
required. 
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SAMPLING FROM AN EXISTENT POPULATION 


It is our purpose to contrast a situation presently to be described, 
with that which obtains in sampling from an existent population, and 
for this reason it is desirable to review some pertinent statistics for the 
example of sampling from a bivariate normal population. There are 
many populations in nature important to study intensively, of associ- 
ated measures u and v, such as the stature and weight of humans of 
like age and sex, or stature of a father and his son, which, if a very 
large group is considered, are closely approximated by a bivariate nor- 
mal distribution. We take the mathematically defined bivariate nor- 
mal population as a model for the real populations which approximate 
it. 

The parameters of such a population are 

a, +—Mean of u and v respectively, 
ou, ¢,—Standard deviation of u and v respectively 
Puv— Correlation coefficient between u and »v. 

The regression of v on wu in this population, that is, the equation 

giving the mean value of v for a specified value of u, is linear. 


D5 = Arn + Bout (3) 


where wu, is the specified value of u, d; is the corresponding mean value 
of v, a», and 8,, are parameters whose values are 
On 


Bou ==" Dus, Anu = 7- Brut. 
Ou 


Similarly, the regression of u on v in this population is 


Uji = Quy + Bucs; (4) 


Ou 
Bur = = Buss yy, = t— Burd. 

Cy 
If we wish to know the regression of v on u, an estimate may be ob- 
tained by taking either (1) a random sample of the entire population or 
(2) a random sample at each of k= 2 selected values of wu. A line is fitted 
by least squares, minimizing the sum of the squared residuals of v (or y). 
The results are pictured in Figure 1. If there is no error in measuring 
the independent variate u, regardless of whether the dependent variate 
has been measured without error as v or with error as y, the regression 
obtained by a least-square fit, minimizing the sum of the squared re- 
siduals of y, is an estimate of the true regression. If, however, the inde- 
pendent variate is measured with error as 2, the regression obtained is a 
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True ljne, a+|Bxj 
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FIGURE 1. Regression of the true measures v on u is linear. Sampling at se- 
lected values of z from an existent population or a controlled experiment, con- 
trolled on z produces a graph of the same appearance; the points representing the 
observations are lined up at specific values of zx. If it is a sample from an existent 
population, an unbiassed error in z produces a bias in the fitted line as shown; if 
it is a controlled experiment the fitted line is unbiassed. 


biassed one, its slope on the average being smaller than the true slope. 
If there is no error we have, measuring u and v from their means, 


> wo 
= ya ; 
Now introduce an unbiassed error d into u so that u is replaced by u+d. 


8! — Litutdy _ > w+ Yd 
“Yuta? YLwt+ Yat+2>d¥ du 
Since d is unbiassed, the last term of both numerator and denominator 
is equal to zero, and 
> w B > u? B ri 
Swt+ da 7™ Swvt da “att+oa 

The bias thus introduced will characterize the fitted line, whether the 
population sampled is a bivariate normal one, or any other population 
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in which the regression of the true measures is linear. And it will be 
present equally whether the sample is a random one of the entire popu- 
lation or if, as is frequently the case, it has been taken at preassigned 
selected values of x (Fig. 1). 

From the same random sample which yields the estimate of the re- 
gression of v on u can be obtained an estimate of the regression of u on 
v, by minimizing the sum of the squared residuals of wu (or x), and such 
an estimate can be obtained also from a sample selected on v. This line 
will not be biassed if u is measured with error as x, but will be biassed 
if v is measured with error as y. 


If both measures are subject to error, the method of least squares provides 
the possibility of obtaining an estimate of the true regression; but, to ac- 
complish this, certain information regarding oa and @, is required [6], and 
Wald [7] has even offered a method for estimation without such knowledge. 
This article, however, deals only with the situation in which there is no in- 
formation respecting the size of og or o,, and in which the more usual type of 
least-square fit, minimizing the sum of the squared residuals of only the one 
variate, is applied. 


CONTROLLED EXPERIMENT 


In contrast to the foregoing situation of an existent population, in 
which we investigate the regression of the population by taking a sam- 
ple from it, I shall now describe what I shal! call a “controlled experi- 
ment.” This experiment is characterized by the fact that the inde- 
pendent variate is a controlled observation. The controlled experiment 
is exemplified in the “bio-assay” experiment, in which organisms are 
exposed to increasing specified concentrations of the material to be 
assayed and in which, therefore, the dosage is a controlled observation. 
It is likewise illustrated in the laboratory investigation concerned with 
two measures related by physical law, such as the Ohm’s law relation- 
ship cited in the quotation from Yule and Kendall. We are there con- 
cerned with the regression assumed as accurately given by E=IR, 
where E is the voltage, J the current and R the resistance, all measured 
without error. The relation can be studied by measuring the current I 
for different specified values of the voltage EZ, or by measuring the 
voltage E for different specified values of the current J. Either of these 
is a controlled experiment; in the first case the voltage is the controlled 
observation, in the second case the current is the controlled observa- 
tion. 

Let us suppose that the physical law governing the relation of the 
two quantities, w and v, correctly measured is 





AMERICAN STATISTICAL ASSOCIATION JOURNAL, JUNE 1950 
Vi = Avu + Bout, (5) 
Ui = Quv + Burrs, (5) 


Bue = 1/Bou; ly = — a, 


1. The quantity u is brought to a specified value as a controlled ob- 
servation u;, measured without error, and the corresponding value of 
the dependent variate v is measured as an uncontrolled observation 
with error as y;. At each of k22 specified values of u, an observation of 
y is made. A line fitted by least squares, minimizing the sum of the 
squared residuals of y, yields the regression 


43 = Ayu + Dyutli. (6) 


The regression (6) has as its expectation the true law (5). 

Similarly, if the quantity v is brought to specified values as controlled 
observations without error and the corresponding value u is measured 
as an uncontrolled observation with error as x, a line fitted by least 
squares, minimizing the sum of the squared residuals of x, will yield 
the regression 


£; = Azy + Devi. (7) 


This regression (7) will be the same as (6), except for sampling differ- 
ences, and also has as its expectation the true law (5). 

In these cases, the results are the same as what they are for the 
situation of sampling from an existent population, where an error in the 
dependent variate does not bias the regression obtained by minimizing 
the squared residual of that variate. 

2. If the first experiment is performed as before, except that the con- 
trolled observation is x measured with error d, instead of without error 
as u, a line fitted by least squares minimizing the sum of the squared 
residuals of y yields the regression 


495 = Ayz + baste (8) 


The regression (8) has as its expectation the true law (&) even in the pres- 
ence of an error in the independent variate x: 

The observation 2; is preassigned, and u differs from it by the un- 
biassed error d; so that u;=2x;—d;. Since in the repeated experiments, 
the average of which defines the expectation, the x; are fixed, the aver- 
age of the slopes by. and the means a@yz are determined by the average 
value of y; for fixed z;. With x; measured from the mean z, 
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E(> 2) =0, DY d)=0, Ede) =9, 
E(dyz) = Gove. 


Similarly, if the experiment is controlled on y measured with error e, 
a line fitted by least squares, minimizing the sum of the squared re- 
siduals of x, is also an unbiassed estimate of the true law (5). 

We have then, in the experiment in which one of the variates is a con- 
trolled observation, two stark differences from the situation of sampling 
from an existent population: 

1. The line estimated by least squares, minimizing the sum of the 
squared residuals of the dependent uncontrolled variate, is the same, 
whether x or y is the controlled variate; that is, there is only one regression. 

2. The estimated line is not biassed by the existence of an error of ob- 
servation in the independent controlled variate, despite our taking no ac- 
count of it in the least-square fit. 


THE MODIFIED CONTROLLED EXPERIMENT?” 


There is a type of experiment not infrequently seen, which may be 
considered a modified variety of the controlled experiment. In this, the 
values of the independent variate are adjusted to begin with to specified 





2 The suggestion to consider this type of experiment was made by Dr. John Tukey and Dr. C. P. 
Winsor. 
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values, as are controlled observations, but these values are not specified 
precisely; if the value desired is say w= Xi, the reading is brought to 
the neighborhood of Xi, and then read as an uncontrolled observation z, 


w=X+4, 
u+td=X+f4+d. 


We shall assume as before that d is independent of u, and x is meas- 
ured with unbiassed error, so that d tends to zero. Say f is independent 
of X and is distributed with mean f and standard deviation o,;. The 
target values X are specified and have standard deviation ox. For a set 
of values X, a series of observations x with corresponding y is made. A 
line fitted by least squares, minimizing the sum of the squared residuals 
of y, has as its expectation 


9: = a! + Bn, (9) 


x 


in which 
ox? + of? 
o,? + of? + o¢? ’ 
a’ = dou + (Bou — B’)Z. 
It is seen that if x is measured with error—that is, cz~0—the line will 


be biassed, but the bias can be reduced to negligible amount by select- 
ing the values of X to cover a wide range. 





B’ = Bou 


WHICH REGRESSION? 


We have seen that in the controlled experiment we do not determine 
which is to be the independent variate by regard to whether y is to be 
predicted from x or x from y, for we obtain the same regression either 
way. What then does determine it? I believe that the choice is governed 
by considerations of practical convenience and regard for the errors of 
estimate. As an example we may consider the sampling error of b, the 
estimate of the regression parameter @. If, with the experiment con- 
trolled on x, we take equally spaced values of x in the range D,, we 
shall say that for an equivalent experiment controlled on y we shall 
take equally spaced values of y in the range D,=8,,D-,; then 


oy” - Putte’, a,” = Pructy*. 


If we control on x, with N observations the sampling variance of by, is 


oe" + Brvuca’® 
a ye = é : 10) 
, No,” ( 
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If we control on y, with N observations the sampling variance of bz, is 


oa" + Bute'® 
Cry = . 11 
bry Noy? ( ) 
If we determine b,. by an experiment controlled on y, we shall esti- 
mate byz as 


b’ yz sa 1/bzy, 


o(1/b,,) _ Fbzy1/Brurv, 
2 2 42 12 2 2 
oye ” O° by] /BYue oa* + B uvFe o f° + B uvtd ; (12) 
Noy?Btuv No,’ 
We see that very interestingly (12) is the same as (10), except that the 
controlled and uncontrolled errors have been interchanged. If x repre- 
sents current and y represents voltage in a controlled experiment, it 
could happen that the error oa’ of bringing the current x to a specified 
controlled observation x; was about equal to or even smaller than the 
error oa of reading current as an uncontrolled observation, whereas the 
voltage y might be difficult to bring to a specified value y; and therefore 
have a large error o,’ as compared with o,, the error when y was read as 
an uncontrolled observation. Under these circumstances, the error of 
the estimate of 8 would be smaller if the experiment were controlled on 
zx, the current, than if it were controlled on the voltage. 

The bio-assay experiment is an extreme example of this sort of thing. 
Here the regression obtained is used to estimate dosage 2, given mor- 
tality rate y; that is, in the actual use of the regression, dosage is the 
dependent variate. But the experiment is performed with dosage as the 
independent variate. Conceivably, and as far as basic principle is con- 
cerned, we might obtain the regression the other way; that is, change 
the dosage in small increments till a specified mortality rate was ob- 
served, and, having done this for a series of mortality rates, minimize 
the sum of the squared residuals of x, the dosage. To do this would be 
immensely difficult practically and o,’, the error of the mortality rate 
as a controlled observation, would be correspondingly large; hence the 
error of estimate of the parameters would also be large if the experi- 
ment were done in this way. So, though in the practical use of the re- 
gression we are to predict the dosage, in the experiment to determine 
this regression the dosage is taken as the independent variate. 











STANDARD ERRORS, TEST FOR LINEARITY, HETEROGENEITY 


In the controlled experiment, the variances about the regression of 
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the uncontrolled observations y or z, as the case may be, are respec- 
tively 


2 
o y°z 


a + B*u0e"?, (13) 
o*,.y sii oa? + Putte”. (14) 


If for each value of x there is not one observation of y but n such 
observations, then for the means 4, in the case of a sample from an 
existent population even with error in z, 


oe"... 


O*y-2 = 





(15) 
n 

If y is normally distributed, a test for linearity of regression based on 
(15) is in wide use. Essentially, this consists in comparing the observed 
variance of 7 about the line with its expectation according to (15). A 
test of significance for the purpose is provided by the technic of the 
analysis of variance for equal or unequal values of n [8]. If the situation 
is a controlled experiment, controlled on x with error, this test will de- 
tect lack of linearity, the effect of errors in x, or a combination of both. 
In interpreting a positive result of such a test, we must consider all 
these possibilities. 

An instructive example which has been used [8] is an experiment 
concerned with the regression of eye-facet number on temperature. Let 
us suppose that k incubators had been set to specified temperatures, n 
flies had been simultaneously exposed in each, and their facet numbers 
had been measured and plotted against temperature. The temperatures 
being specified, this is a controlled experiment. We know that, in the 
experiment referred to, the temperature was measured with rather 
large error [9]; we shall suppose that the error was sufficiently close to 
unbiassed to warrant proceeding on that assumption. The fitting of the 
least-squares line, minimizing the sum of the squared residuals of y, 
was therefore appropriate.* However, the variance of the means about 
the line is not 








2 C74 -2 a, Pita’ 
Oj-2 = = ——— ; 
n n n 
but a larger quantity 
a.” . 
o*5.2 = oo Brvuta 2, (16) 
n 





3 If the incubators were at “randomly” distributed true temperatures u and the temperatures were 
measured as uncontrolled observations with error as z, we should be dealing with the situation of sam- 
pling from an existent population and the line itself would be biassed. 
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This is so because, under these circumstances, the variance of the 
means 7 is not decreased with increasing n so far as that portion of the 
variance of y is concerned which reflects the error of x. The application 
of the analysis of variance test for linearity will therefore give frequent 
positive results due to errors in x, whether or not the relation of eye- 
facet number and temperature is linear. Some other technic will be 
needed to investigate linearity. 

Similar possibilities of misinterpretation are associated with the use 
of other tests of significance that involve estimates of variance about 
fitted regressions, when these are applied to the results of a controlled 
experiment. For instance, in the use of the x? test with the bio-assay 
experiment, to test “heterogeneity,” [10] if there is error in the measure 
of dosage, a lack of homogeneity may be ascribed to the experimental 
animals whereas it may be really attributable to the experimenters 
themselves in the preparation of the dosages. 

Another result that may appear paradoxical is the violation, in the 
controlled experiment, of a rule seen in good statistical works and which 
I myself put forth a number of years ago in a review of Treloar’s text- 
book [11]. This rule is to the effect that one always minimizes the vari- 
ate which is actually subject to error. But suppose the controlled obser- 
vation is with error that is measured as x, while the dependent variate 
is measured without error as v. The rule still holds that we minimize the 
sum of the squared residuals of the dependent variate. Thus we mini- 
mize the residual of v which is measured exactly, while leaving alone z, 
the measure subject to error. The result will be, nevertheless, an esti- 
mate of the true regression. Paradoxically, if we minimize the residual 
of the erroneous measure 2, the line will be biassed. 


THE CORRELATION COEFFICIENT 


In the case of sampling from a bivariate normal population, the two 
regressions of the population are individually significant and their 
separate determination is a scientifically meaningful objective. In the 
measurements of a human population, the line of mean weight for given 
stature is different from the line of mean stature for given weight. For 
the erection of standard normal tables of stature and weight, the 
mathematical model of a bivariate normal population is useful, even 
essential, and tables giving average weight for specified stature cannot 
be used to give average stature for specified weight, as I have had fre- 
quent necessity to point out in my consultations. The same is true for 
the two respective means, @ and 5, of the population and the standard 
deviations, o, and o,. Equally, the correlation coefficient p,, is as ap- 
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propriate for study as any other of the parameters defining the popula- 
tion, for it is a specified population, and the individuals in it, that we 
are studying. If the possible effect of a change of environment on the 
structure of an organism is being investigated, the significant effect 
may appear in one of the regressions but not in the other, while the 
change in correlation may be just the best epitome of what has hap- 
pened. 

In the situation of the controlled experiment, it seems to me, the case 
is quite different and the model of sampling from an existent popula- 
tion, bivariate normal or other, breaks down.‘ Here we have no de- 
finable existent population, the constitution of which is the subject of 
inquiry, and to determine which we deal with a sample. For instance, 
realistically there is no existent population of voltage and current meas- 

“urements waiting to be “sampled.” If anything “exists,” and this is 
only a figure of speech, it is the fact of a fixed relation between certain 
measurements when they are made, and it is the constants of this rela- 
tion that we are trying to ascertain. A set of scientific observations 
made to determine the resistance of a circuit is obtained: by a defined 
procedure; the procedure is certainly not literally a “sampling” pro- 
cedure, and there is no physically identifiable population being sampled 
from.' There being no population, there is no population parameter p.» 
to be estimated in these situations. To be sure, with a set of observa- 
tions in hand one can calculate a value of r “as if” it were the estimate 
of some pu», and one frequently sees such calculations. But where is the 
population whose pu, is being estimated? The calculated values will in 
fact depend in these circumstances on arbitrary and irrelevant factors 
such as the range over which the controlled variate was taken, the 
expected value of r being larger the larger the range [12]. In such circum- 
stances, the correlation coefficient has no scientific meaning. 

Perhaps we can find here a way of reconciling the views of those who 
use the correlation coefficient extensively and those who rather dep- 
recate it. Where there is an identifiable population, the parameters of 
which are of scientific import, the calculation of r may be meaningful, 
but in the controlled experiment, not representing any sample from a 
definable and significant population, its calculation is quite futile. 

With respect to the distinction which has been drawn between the 





4 As Neyman has somewhere sagaciously remarked, the problem of statistics is twofold. There is the 
mathematical problem of deducing the results from the given model, and there is the problem of whether 
and how fer the model applies to the question in hand. 

5 Doubtless it is something closely equivalent to this that Winsor [4] had in mind when he said, 
referring to the bio-assay experiment, “even the notion of a population distribution of z values becomes 
so vague as to be meaningless.” 
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situations in which an error in x does and does not produce bias in the 
fitted line, the following points are to be emphasized. 

1. What has been said regarding the bias applies not only to samples 
from the bivariate normal population; it applies to samples from any 
population in which the true regression is linear. 

2. The observations to which the line is fitted may be a random sam- 
ple of the population as a whole, or one for selected values of x; in the 
latter case, the plotted graph has the same appearance as one made for 
observations from a controlled experiment (Fig. 1). 

3. The quantities represented by y (or v) may be physical measure- 
ments, and the deviations from the regression therefore represent errors 
of observations,® or they may be biologic measurements, and the devia- 
tions from the regression therefore represent biologic variation. 

(a) For instance, if for a given electric circuit we are investigating 
the Ohm’s law relationship, V=RI, to determine R, and instead of 
performing a controlled experiment, we collect records of simultaneous 
readings that have been made of voltage V and current IJ, then if the 
voltage has been measured with unbiassed error, the fitted regression 
of I on V will be biassed. This is so because the accumulated records 
constitute an existent population, and the data were obtained by sampl- 
ing observations which, in the first instance, were uncontrolled observa- 
tions. For the same circuit, if the observations were obtained by means 
of a controlled experiment on voltage measured with unbiassed error, 
the fitted line would be unbiassed. 

(b) Counterwise, the values of y (or v) may represent biologic varia- 
tion, but, if the experiment is controlled, the line will be unbiassed. 
This was exemplified in the control experiment investigating the rela- 
tion of eye-facet number to temperature. Here the observations that 
constitute the dependent variate represent biologic variations, not 
errors of measurement, but statistically we have the same situation as 
for the “functional” relation of Ohm’s law, when this is investigated by 
means of the controlled experiment; that is, even with error in z, the 
line is unbiassed. 

The distinction between the two situations resides not in what the 
variate y represents, but in how the observations are acquired. If the 
values x are obtained by taking a sample from an existent population, 
we have the biassed situation, if they are obtained by making them as 
controlled observations, we have the unbiassed situation. 





¢ In these circumstances, the relation between the variates represented by the regression is some- 
times referred to as “functional.” 





180 AMERICAN STATISTICAL ASSOCIATION JOURNAL, JUNE 1950 


To the Drs. G. Brown, C. Eisenhart, F. Mosteller, W. R. Thompson, 
J. Tukey and C. P. Winsor, I am grateful for the sanguinary argument 
that resulted in this paper. They cannot be held responsible for any 
errors contained in it, for I frequently refused to take their advice, but 
there would be many more errors if I had always refused. 
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SOME NEW ASPECTS OF THE APPLICATION OF MAX- 
IMUM LIKELIHOOD TO THE CALCULATION 
OF THE DOSAGE RESPONSE CURVE 


JEROME CORNFIELD AND NATHAN MANTEL 
National Cancer Institute, Bethesda, Maryland 


The estimation of the parameters of dosage response curves 
by the standard probit method is an iterative process begin- 
ning with approximations to the parameters and using one or 
more cycles of computations to “improve” these estimates 
until they converge. The present paper gives a table and 
method for computing the maximum likelihood solution which 
converges more rapidly than the standard probit method. A 
procedure is presented for obtaining more accurate initial 
approximations, and the problem of the bias of the maximum 
likelihood estimates in small samples is considered. 


1. INTRODUCTIO. 


HERE ARE MANY fields, medicine, biology, pharmacology, engineer- 
oo to name a few—in which it is necessary to estimate the pa- 
rameters of a curve relating dosage and response. Of the many methods 
developed to solve this problem probably the best known and most 
widely applied in the case of quantal responses is the probit method [1]. 
The most important bar to an even wider application of this method 
has been the burden of calculation required. One feature of the probit 
method which makes this burden particularly heavy is that in general 
the probit solution is an iterative solution. One begins with approxima- 
tions to the parameters to be estimated. One cycle of computation 
yields “improved” estimates, an additional cycle further improve- 
ments, and so on until the estimate converges. In some applications one 
cycle is sufficient; in others several are required. 

In the present paper we consider: 

(a) a method for computing a maximum likelihood solution which 
converges more rapidly than the standard probit method, 
which we shall henceforth refer to as the Bliss-Fisher method. 

(b) the use of the Churchman-Epstein generalization of Karber’s 
method [2, 3, 4] to obtain more accurate initial approximations 
in many cases. 

(c) the problem of the bias of the maximum likelihood estimates 
in small samples. 
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Il. THE MAXIMUM LIKELIHOOD SOLUTION 
1. The theoretical basis 


The probit method is based on the assumption that the observed re- 
sponses at each dose level are samples from a population in which the 
true percentage, P;, at the ith log dose, X;, is given by: 


xX; 
(1) P; = | e~ (Xn)? 1207 X 
oV2rJ _. 
The method itself is essentially a procedure for obtaining maximum 


likelihood estimates of the parameters » and c. The equations defining 
these estimates are [4]: 





‘ 3, 

L 5g, — MP) = 0 

u Pd. (r; —_ niP;) = 0 
where 


X; = log dose at the 7th level 
nm; = number tested at the zth level 
r; = number responding 


os 1 
Zi = — e7 (Xi-2)* 120" 


6/24 


x; ms 
f Zax. 


The equations (2) are non-linear in # and é and can be solved only 
by an iterative process. The general procedure for solving equations 
which are not linear in the unknowns, expansion in Taylor’s series 
around approximate values of the unknowns, is well established [5]. 
Application of this method to the equations (2) yields, as Garwood has 
shown [6]: 
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where 
Zo? ZoYo ZoYo Zo 
A= Ble 0G - SS, ee 
Xu l Qo? Qo Po Po? 
a X — Ho 
oo 
= > nw’ 
B= > nw'X 
C= > nw’X? 
b = 1/é 
_ "yp, 
a=-— /é 


and the subscript o denotes a provisional value. 

The equations (3) are only approximations to the equations (2), so 
that even their exact solution still may not yield an exact solution 
of (2). The Bliss-Fisher solution may be obtained from (3), as 
Finney has indicated [1], by the further approximation of setting r in 
w’ equal to its expected value, nP. In that case w’ reduces immediately 
to Z?/PQ and the equations (3) lead directly to the Bliss-Fisher pro- 
cedure. We should expect, however, that this additional approximation 
would result in somewhat slower convergence. That this is in fact true 
was demonstrated by Garwood. In every case in which we have applied 
both methods to the same set of data, Garwood’s procedure has con- 
verged more rapidly. Garwood also showed, however, that while use of 
the complete value of w’ might result in convergence with fewer cycles 
of computation, it required considerably more calculation per cycle. In 
consequence the Bliss-Fisher procedure, despite slower convergence re- 
quired less overall calculation.! 

This conclusion applies, of course, only so long as it is necessary to 
compute w’ anew for each set of data.? If it were possible, however, to 
tabulate w’ once and for all, then the amount of computation in Gar- 
wood’s solution could be reduced considerably, while retaining the de- 
sirable feature of more rapid convergence. 

Since w’ is a function of two variables, the normal deviate Y and the 





1 Another way of deriving the Bliss-Fisher procedure is to consider Z/PQin (2) as given bya previous 
approximation and to expand the P in the parenthesis as a function of sand @. In that case the Garwood 
procedure differs by using not the Z/PQ of a previous solution, but that Z/PQ as adjusted by the solution 
being computed. From this point of view as well we should expect the Garwood procedure to converge 
more rapidly. 

2 The notation w’ is used in analogy with the w of the Bliss-Fisher procedure. When the approxima- 
tion r =nP is made, w’ reduces to w. . 
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empirical percentage p(=r/n), it can consequently be tabulated in at 
least two ways: 

(a) In a table much like the present tables of working probits, in 
which the table is entered with the double argument Y and p and 
the value of w’ read off. 

(b) In a table entered with the single argument Y, in which are read 
off the two values, 


Z* ZY ZY 2 
W' min (- —- —) and w'nes (= —-+ =): 
Q Q rr F 


Then w’ becomes 


a [(n cal r)W' min + rw’ max |. 
n 


Tables of type (a) eliminate a computation because of the double argu- 
ment, but are for that reason very bulky. In consequence there is fre- 
quently an insufficient range of variation in the argument of such tables 
to include all the combinations of provisional probits and empirical 
per cents that can actually occur. Furthermore, the provisional probit 
is of necessity tabulated in intervals of .1, so that interpolation (which 
may be quite inaccurate for so wide an interval) is often necessary. In 
those cases what is saved by eliminating a computation may be lost by 
interpolation. For these reasons it has seemed desirable to tabulate 
W'min aNd W'max Separately as in (b). 

The right hand side of (3) can be treated as it now is in the Bliss- 
Fisher procedure, but for comparability of treatment an additional 
simplification seems desirable. We may write >>(Z/PQ)(r—nP) as 





E[rS- mn Z]= ma 





and minimum and maximum values of 
i--= = 
A{ = ——, 
Q P 


3 A is, in effect, in the Bliss-Fisher method, the weighted deviation of the working probit y, from the 


provisional probit, Y 
slr) “(FS -¥) Fa”) 
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1950 
TABLE 1 
1 at TABLE OF UNIT WEIGHTED DEVIATIONS (4) AND UNIT WEIGHTS (w’), MINIMUM AND 
MAXIMUM FOR PROBITS FROM 0 TO 10 
“ Minimum response Maximum response , _ Minimum response Maximum response . 
, In Probit w’ w’ Probit Probit A w’ A w’ Probit 
and 5.00 .79788 .63662  .79788 .63662 5.00 
5.01 .80426 .63879 .79153 .63443 4.99 5.71 1.29813 .76346 .40736 .45517 4.29 
5.02 .81066 .64096 .78520 .63224 4.98 5.72 1.30577 .76488 -40282 .45230 4.28 
5.03 -81708 .64311 .77888 .63003 4.97 5.73 1.31342 .76628 .39831 .44942 4.27 
2ad 5.04 .82352 .64525 .77260 .62781 4.96 5.74 1.32109 .76768 .39383 .44654 4.26 
5.05 .82999 .64738 .76633 .62558 4.95 5.75 1.32878 .76907 .38938 .44365 4.25 
5.06 .83647 .64949 .76008 .62333 4.94 5.76 1.33648 .77045 .388496 .44076 4.24 
5.07 84298 .65160 .75386 .62108 4.93 5.77 1.34419 .77182 .38057 .43787 4.23 
5.08 84950 .65369 .74766 .61881 4.92 5.78 1.35191 .77317 -37620 .43497 4.22 
5.09 85604 .65578 74149 .61653 4.91 5.79 1.3 - 77453 .37187 .43206 4.21 
5.10 86262 .65785 73533 .61425 4.90 5.80 1.36740 .77587 .36756 .42915 4.20 
5.11 86921 .65991 72920 .61195 4.89 5.81 1.37517 .77720 .36328 .42624 4.19 
§.12 87582 .66195 72309 4.88 5.82 1.38295 .77852 .35904 .42332 4.18 
5.13 88245 .66399 71701 .60731 4.87 5.83 1.39074 .77984 -35482 .42040 4.17 
5.14 88910 .66602 71095 .60498 4.86 5.84 1.39854 .78115 .35063 .41747 4.16 
5.15 89577 .66803 70491 .60263 4.85 5.85 1.40636 .78245 .34647 .41454 4.15 
5.16 90246 .67003 69889 .60028 4.84 5.86 1.41419 .78373 .34234 .41161 4.14 
5.17 90917 .67202 69290 .59791 4.83 5.87 1.42204 .78501 .33824 .40867 4.13 
5.18 91590 .67400 68694 .5 4.82 5.88 1.42989 .78629 -33416 .40573 4.12 
5.19 92265 .67597 59314 4.81 5.89 1.43776 .78755 .33012 .40279 4.11 
5.20 92942 .67793 67507 .59074 4.80 5.90 1.44564 .7 32611 4.10 
5.21 93620 .67988 -66918 58833 4.79 5.91 1.45354 .79005 .32213  .39690 4.09 
5.22 94301 .68181 .66331 .58590 4.78 5.92 1.46144 .79129 .31817 .39395 4.08 
' 5.23 94984 .68373 .65746 .58347 4.77 5.93 1.46936 .79252 .31425 .39100 4.07 
u- 5.24 95669 .68564 .65164 .58102 4.76 5.94 1.47729 .79374 .31035  .3 4.06 
, 5.25 96355 .68755 .64584 .57857 4.75 5.95 1.48524 .79496 .30649 .38509 4.05 
e- 5.26 97044 .68944 -64007 .57610 4.74 5.96 1.49319 .79616 30265 .38214 4.04 
= 5.27 97734 .69132 .63432 .57362 4.73 5.97 1.50116 .79736 .29884 .37918 4.03 
es 5.28 98427 .69318 .62859 .57114 4.72 5.98 1 14 .79855 .29507  .37623 4.02 
l 5.29 99121 .69504 .62289 .56864 4.71 5.99 1.51713 .79973 .29132 .37327 4.01 
a 5.30 99817 .69689 .61722  .56613 4.70 6.00 1.52513 . .28760 .37031 4.00 
it 5.31 1.00514 .69872 .61157 .56361 4.69 6.01 1.53315 .80207 .28391 .36736 3.99 
} 5.32 1.01214 .70054 .60594 .56108 4.68 6.02 1.54118 .80323 .28025 .36440 3.98 
1) 5.33 1.01915 .70236 .60035 .55854 4.67 6.03 1.54921 .80437 .27662 .36144 3.97 
’ 5.34 1.02619 .70416 .59478 .55599 4.66 6.04 1.55726 .80552 .27302 .35849 3.96 
Nn 5.35 1.03324 .70595 .58923 .55342 4.65 6.05 1.56532 . 26945 5553 «3.95 
5.36 1.04031 .70773 .58371 .55085 4.64 6.06 1.57340 .80778 .26591 .35258 3.94 
ry 5.37 1.04739 .70950 .57821 .54827 4.63 6.07 1.58148 .80890 .26240 .34963 3.93 
‘ 5.38 1.05450 .71125 .57274 .54568 4.62 6.08 1.58958 .81001 -25892 .34667 3.92 
e 5.39 1.06162 .71300 .56730 .54308 4.61 6.09 1.59768 .81111 .25547 .34373 3.91 
5.40 1.06876 .71474 .56188 .54047 4.60 6.10 1.60580 .81221 .25205 .34078 3.90 
“l 5.41 1.07591 .71646 .55649 .53784 4.59 6.11 1.61392 .81330 .24865 .33783 3.89 
és 5.42 1.08309 .71818 -55113 .53521 94.58 6.12 1.62206 .81438 .24529 .33489 3.88 
l 5.43 1.09028 .71988 .54579 .53257 4.57 6.13 1.63021 .81545 .24196 .33195 3.87 
L 5.44 1.09748 .72158 .54047 .52992 4.56 6.14 1.63837 .81652 -23865 .32902 3.86 
5.45 1.10471 .72326 .53519 .52726 4.55 6.15 1.64654 .81758 .23538 .32608 3.85 
5.46 1.11195 .72493 .52993 .52459 4.54 6.16 1.65472 .81863 .23213 .32315 3.84 
5.47 1.11921 _ 72659 .52470 .52191 4.53 6.17 1.66292 .81968 .22891 .32023 3.83 
5.48 1.12648 2825 .51949 .51923 4.52 6.18 1.67112 .82071 .22572 .31731 3.82 
5.49 1.13377 .72989 .51431 .51653 4.51 6.19 1.67933 .82175 .22257  .31439 3.81 
5.50 1.14108 .73152 -50916 .51382 4.50 6.20 1.68755 .82277 .21944 .31148 3.80 
5.51 1.14840 .73314 -50404 .51111 4.49 6.21 1.69578 .82379 .21634 .30857 3.79 
5.52 1.15574 .73475 .49894 .50839 4.48 6.22 1.704 . 82480 .21327 .30567 3.78 
5.53 1.16310 .73635 -49387 .50566 4.47 6.23 1.71228 .82580 -21022 .30277 3.77 
5.54 1.17047 .73794 -48883 .50292 4.46 6.24 1.72054 .82680 20721 .29988 3.76 
5.55 1.17786 .73952 -48381 .50017 4.45 6.25 1.72882 .82779 . 204 .29699 3.75 
5.56 1.18526 .74109 -47882 .49741 4.44 6.26 1.73710 .82877 -20127  .29411 3.74 
5.57 1.19268 .74265 -47386 .49465 4.43 6.27 1.74539 .82975 .19834 .29124 3.73 
5.58 1.20011 .74420 -46893 .49187 4.42 6.28 1.75369 .83071 .19545 .28837 3.72 
5.59 1.20756 .74574 -46402 .48909 4.41 6.29 1.76201 .83168 .19258 .28551 3.71 
5.60 1.21503 .74727 -45915 .48630 4.40 6.30 1.77033 .83263 .18974 .28265 3.70 
5.61 1.22251 .74879 -45430 .48351 4.39 6.31 1.77866 .83358 18692 .27981 3.69 
5.62 1.23000 .75030 -44948 .48071 4.38 6.32 1.78699 .83453 18414 .27697 3.68 
5.63 1.23751 .75180 -44468 .47789 4.37 6.33 1.79535 .83547 .18138 .27414 3.67 
5.64 1.24504 .75329 .43992 .47508 4.36 6.34 1.80371 .83640 .17866 .27132 3.66 
5.65 1.25258 .75478 -43518 .47225 4.35 6.35 1.81208 .83732 17596 .26850 3.65 
5.66 1.26013 .75625 -43047 .46942 4.34 6.36 1 . 83824 17329 .26570 3.64 
5.67 1.26770 .75771 .42579 8 33 6.37 1.82884 .83915 17064 .26290 3.63 
5.68 1.27529 .75916 .42114 .46374 4.32 6.38 1.83724 .84006 . 16803 .26011 3.62 
5.69 1.28289 .76061 -41652 .46089 4.31 6.39 1.84564 .84095 -16544 .25733 3.61 
5.70 1 . 76204 .41192 .45803 4.30 6.40 1.85406 .84185 - 16288 .25456 3.60 
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.4 

, 3 

, 3. 

q 3. 2 

. 3. 2 

. 3. 7. 2 
6. 3. q 2 
6. 3. a: 2 
6. 3. wa 2. 
6.51 1.94719 .85128 13653 .22480 3.49 7.21 2.56047 736 =. .03518 07898 = 2.7 
6.52 1.95570 .85211 13429 .22216 3.48 7.22 2.56944 .89787 .03440 .07754 2.7 
6.53 1.96423 .85292 13209 .21954 3.47 7.23 2.57842 9 .03363 .07612 2.7 
6.54 1.97276 73 12990 .21693 3.46 7.24 2.58741 .89889  .03287 .07472 2.7 
6.55 1.98130 .85454 12775 .21433 3.45 7.25 2.59640 .89940 .03213 .07333 2.7 
6.56 1.98985 .85534 12562 .21174 3.44 7.26 40 .89990  .03141 .07196 2.7 
6.57 1.99841 .85614 12351 .20917 3.43 7.27 2.61440 .90040 .03069 .07062 2.7 
6.58 2.00697 .85693 12143 .20661 3.42 7.28 2.62341 -02999 .06929 2.7 
6.59 2.01555 .85771 ll 20407 3.41 7.29 2.63242 .90139 -02931 .06797 2.7 
6.60 2.02413 .85849 .11735 .20153 3.40 7.30 2.64143 .90188 -02863 .06668 2.7 
6.61 2.03272 .85927 11535 .19902 3.39 7.31 2.65046 .90236 02797 .06540 2.69 
6.62 2.04131 .86004 11337 .19651 3.38 7.32 2.65948 .90285 02733 .06414 2.68 
6.63 2.04992 .86080  .11142 .19403 3.37 7.33 3 - 90333 02669 .06290 2.67 
6.64 2 -86156 .10949 .19155 3.36 7.34 2.67755 .90380 02607 .06168 2.66 
6.65 2.06715 .86231 -10759 .18909 3.35 7.35 2.68659 .90428 02546 7 2.65 
6.66 2.07578 .86306 10571 3.34 7.36 2.69563 .90475 02486 .05928 2.64 
6.67 2.08441 .86380 18422 3.33 7.37 2.70468 .90521 02427 .05811 2.63 
6.68 2.09305 .86454 10202 .18181 3.32 7.38 2.71374 .90568 -02370 .05696 2.62 
6.69 2.10170 .86527 10022 .17941 3.31 7.39 2.72280 .90614 -02313 .05582 2.61 
6.70 2.11036 .86600 09844 .17703 3.30 7.40 2.73186 .90660  .02258 .05470 2.60 
6.71 2.11902 .86673 17466 3.29 7.41 2.74093 .90705 -02204 .05360 2.59 
6.72 2.12769 .86744 09494 .17232 3.28 7.42 2.75000 .90751 02151 .05251 2.58 
6.73 2.13637 .86816 09323 .1 3.27 7.43 2.75908 .90796 05144 = 2.57 
6.74 2.14506 .86887 09154 .16766 3.26 7.44 2.76816 .90840 02048 9 2.56 
6.75 2.15375 .86957 08988 .16536 3.25 7.45 2.77725 .90885 01998 .04935 2.55 
6.76 2.16245 .87027 .08824 .1 3.24 7.46 2.78634 .90929 01949 .04833 2.54 
6.77 2.17115 .87096 . 16081 3.23 7.47 2.79543 .90973 01901 .04732 2.53 
6.78 2.17987 .87165 . 15856 3.22 7.48 2. 91016 01855 .04634 2.52 
6.79 2.18859 .87234 -08344 3.21 7.49 2.81364 .91060 -01809 .04536 2.51 
6.80 2.19731 .8 -08189 .15411 3.20 7.50 2.82274 .91103 -01764 .04441 2.50 
6.81 2 87370 §=©. .08086_-.15191 3.19 7.51 2.83186 .91145 -01720 .04346 2.49 
6.82 2.21479 .87437 -07885 .14973 3.18 7.52 2.84097 .91188 -01677  .04254 2.48 
6.83 2.22353 504 -07737 .14757 3.17 7.53 2.85009 .91230 -01635 .04163 2.47 
6.84 87570 .07590 .14542 3.16 7.54 2.85922 .91272 -01594 .04073 2.46 
6.85 2.24105 .87636 07446 + .14329 3.15 7.55 2.86835 .91314 -01553 .03985 2.45 
6.86 2.24981 .87701 07304 .14118 3.14 7.56 2.87748 .91355 -01514 .03898 2.44 
6.87 2.25859 .87766 07164 .13909 3.13 7.57 88662 .91396  .01475 .03813 2.43 
6.88 2.26737 .87831 07026 .13702 3.12 7.58 2.89576 .91437 -01438 .03730 2.42 
6.89 2.27615 .87895 13496 3.11 7.59 2.90491 .91478 01401 2.41 
6.90 2.28495 .87958 06756 .13292 3.10 7.60 2.91406 .91518 01365 .03567 2.40 
6.91 2.29375 .88022 06624 .13090 3.09 7.61 2.92321 .91558 01329 .03487 2.39 
6.92 2.30255 .88084 06494 .12890 3.08 7.62 2.93237 .91598 01295 .03409 2.38 
6.93 2.31136 .88147 06366 .12691 3.07 7.63 2.94153 .91638 01261 .03333 2.37 
6.94 2.32018 .88209 06: 12495 3.06 7.64 2.95070 .91677 01228 2.36 
6.95 2.32900 .88270 .06116 3.05 7.65 2.95987 .91716 01196 .03184 2.35 
6.96 2.33783 .88331 05 12107 3.04 7.66 2.96904 .91755 01165 .03111 2.34 
6.97 2.34667 .88392 -05874 .11916 3.03 7.67 2.97822 .91794 01134 .03040 2.33 
6.98 2. 1 .88453 -05756 .11727 3.02 7.68 2.98740 .91832 01104 .02970 2.32 
6.99 2.36436 .88513 -05639 .11540 3.01 7.69 2. 91870 01074 + .02902 2.31 
7.00 2.37322 .88572 05525 .11355 3.00 7.70 3.00577 .91908 01046 .02834 2.30 
7.01 2.38208 .88631 05412 .11171 2.99 7.71 3.01497 .91946 01018 .02768 2.29 
7.02 3 88690 .05301 .1 2.98 7.72 3.02416 .91983 -00990 .02704 2.28 
7.03 2.39981 .88748  .05192 .10810 2.97 7.73 3.03336 .92021 -00963 .02640 2.27 
7.04 2.40869 -05085 .10632 2.96 7.74 04257 .92058  .00938 .02578 2.26 
7.05 2.41757 .88864 -04980 .10456 2.95 7.75 3.05177 -00912 .02517 2.25 
7.06 2.42646 .88921 -04876 .10282 2.94 7.76 -92131 -00887 .02457 2.24 
7.07 2.4 - 88978 -04774 .10110 2.93 7.77 3.07020 .92167 00863 2.23 
7.08 2.44426 .8 04674 2.92 7.78 3.07942 .92203 9 .02340 2.22 
7.09 2.45317 .89091 04575 .09772 2.91 7.79 3.08864 .92239 00816 .02284 2.21 
7.10 2.46208 .89146 04478 2.90 7.80 3.09787 .92275 00794 .02228 2.20 
Probit A w’ 4 w’ Probit Probit w’ A w’ Probit 
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Minimum response Maximum response Minimum response Maximum response 
Probit 4 w’ A w’ Probit Probit A w’ A w’ Probit 
7.81 3.10710 .92310 -00772 .02174 2.19 8.51 3.76082 .94330 -00084 .00296 1.49 
7.82 3.11633 .92346 -00750 .02121 2.18 8.52 3.77026 -00081 .00286 1.48 
7.83 3.12556 .92381 -00729 .02069 2.17 8.53 3.77969 .94377 .00079 .00277 1.47 
7.84 3.13480 .92415  .00709 .02018 2.16 8.54 3.78913 .94400  .00076 .00268 1.46 
7.85 3.14405 .92450  .00689 .01968 2.15 8.55 3.79857 .94423  .00073 .00260 1.45 
7.86 3.15329 .92484 00669 .01919 2.14 8.56 80802 .94445 -00071 .00251 1.44 
7.87 3.16254 .92518  .00650 .01871 2.13 8.57 3.81746 4 -00068 .00243 1.43 
7.88 3.17180 .92552 -00632 .01824 2.12 8.58 3.82691 .94491 -00066 .00235 1.42 
7.89 3.18105 .92586 -00614 .01778 2.11 8.59 3.83636 .94513 -00063 .00228 1.41 
7.90 3.19032 .92620 -00596 .01733 2.10 8.60 3.84581 .94535 -00061 .00220 1.40 
7.91 3.19958 .92653 00579 .01689 2.09 8.61 3.85527 .94557  .00059 .00213 1.39 
7.92 3.20885 .92686 00563 .01646 2.08 8.62 3.86472 .94579 -00056 .00206 1.38 
7.93 3.21812 .92719 00546 .01604 2.07 8.63 3.87418 .94601 -00055 .00199 1.37 
7.94 3.22739 .92752 1 .01562 2.06 8.64 88364 .94623 -00053  .00193 1.36 
7.95 3.23667 .92784 00515 .01522 2.05 8.65 3.89311 .94645 -00051 .00186 1.35 
7.96 3.24595 .92817 -01483 2.04 8.66 3.90257 .94666 -00049 .00180 1.34 
7.97 3.25523 .92849 00485 .01444 2.03 8.67 3.91204 .94688 -00047  .00174 1.33 
7.98 3.26452 .92880 00471 .01406 2.02 8.68 3.92151 .94709 -00046 .00168 1.32 
7.99 3.27381 .92913 00457 .01369 2.01 8.69 3.93098 .94730 -00044 163 1.31 
8.00 3.28310 .92944 00444 .01333 2.00 8.70 3.94046 .94751 -00042 .00157 1.30 
8.01 3.29239 .92975 00431 .01298 1.99 8.71 3.94 94772 -00040 .00152 1.29 
8.02 3.30169 .93007 00418 .01264 1.98 8.72 3.95941 793 -00039 .00147 1.28 
8.03 3.31100 .93038 00405 .01 1.97 8.73 3.96889 .94814 -00038 .00142 1.27 
8.04 3.32030 .93069 93 .01197 1.96 8.74 3.97837 -00037 .00137 1.26 
8.05 3.32961 .93099 00381 .01165 1.95 8.75 3.98786 .94855 .00035 .00132 1.25 
8.06 3.33892 .93129 00370 .01133 1.94 8.76 3.99735 .94875 -00034 .00128 1.24 
8.07 3.34824 .93160 9 .01103 1.93 8.77 4.00683 -00033 .00123 1.23 
8.08 3.35755 .93190 00348 .01073 1.92 8.78 4.01632 .94916  .00031 .00119 1.22 
8.09 3.36687 .93220 00337 .01043 1.91 8.79 4.02582 -00030 .00115 1.21 
8.10 3.37620 .93250 00327 .01015 1.90 8.80 4.03531 .94956 -00029 .00111 1.20 
8.11 3.38552 .93279 -00317 .00987 1.89 8.81 4.04481 .94976 -00028 .00107 1.19 
8.12 3.39485 .93308 -00307 .00960 1.88 8.82 4.05431 .94995 -00027 .00103 1.18 
8.13 3.40419 .93338 -00298 .00933 1.87 8.83 4.06381 .95015 .00026 .00100 1.17 
8.14 3.41352 .93366 -00289 .00907 1.86 8.84 4.07331 .95034 -00025 .00096 1.16 
8.15 -42286 .93396 00280 .00882 1.85 8.85 4.08281 .95054 -00024 .00093 1.15 
8.16 3.43220 .93424 00271 .00857 1.84 8.86 4.09232 .95073 -00023 .00090 1.14 
8.17 3.44154 .93453 -00263 .00833 1.83 8.87 4.10183 .95092 -00022 .00086 1.13 
8.18 3.45089 .93481 -00254 .00809 1.82 8.88 4.11134 .95111 -00021 .00083 1.12 
8.19 3.46024 .93509 -00246 .00786 1.81 8.89 4.1 - 95130 -00021 .00080 1.11 
8.20 3.46959 .93537 -00239 .00764 1.80 8.90 4.13037 .95149 -00020 .00077 1.10 
8.21 3.47895 1 .00742 1.79 8.91 95168 -00019 .00075 1.09 
8.22 3.4 93593 00224 .00721 1.78 8.92 4.14940 .95187 -00018 .00072 1.08 
8.23 3.49767 .93620 00217 .00700 1.77 8.93 -00018 .00069 1.07 
8.24 3.50703 .93648 00210 .00680 1.76 8.94 4.16844 .95224 -00017 .00067 1.06 
8.25 3.51640 .93675 -00660 1.75 8.95 4.17796 .95242 -00017 .00064 1.05 
8.26 3.52576 .93702 00197 .00641 1.74 8.96 4.18749 .95260 -00016 .00062 1.04 
8.27 3.53514 .93729 00190 .00622 1.73 8.97 4.19702 .95279 -00016 .00060 1.03 
8.28 3.54451 .93756 00184 .00604 1.72 8.98 95297 .00015 .00058 1.02 
8.29 3.55389 .93782 00178 .00586 1.71 8.99 4.21607 .95315 -00014 .00056 1.01 
8.30 3.56327 .93809 00172 .00569 1.70 9.00 4.22561 .95333  .00014 .00054 1.00 
8.31 3.57265 835 -00167 .00552 1.69 9.01 4.23514 .95351 -00013 .00052 -99 
8.32 3.58203 .93861 -00161 .00536 1.68 9.02 4.24468 .95368 -00012 .00050 -98 
8.33 3.59142 .93887 -00156 .00520 1.67 9.03 4.25421 .95386 -00012 .00048 -97 
8.34 3.60081 .93913 -00151 .00504 1.66 9.04 4.26375 .95403 -00011 .00046 - 96 
8.35 3.61020 .93939 -00146 .00489 1.65 9.05 4.27330 .95421 -00011 .00044 95 
8.36 3.61960 .93964 00141 .00474 1.64 9.06 4.28284 .95438 -00011 .00043 94 
8.37 3.62900 .93990 00136 .00460 1.63 9.07 4.29238 .95455 -00010 .00041 -93 
8.38 3.63840 .94015 00132 .00446 1.62 9.08 4.30193 .95473 -00010 .00040 -92 
8.39 3.64780 .94040 00128 .00432 1.61 9.09 4.31148 .95490 -00009 .00038 -91 
8.40 3.65720 .94065 00123 .00419 1.60 9.10 4.32103 .95507 -00009 .00037 -90 
8.41 3.66661 .94090 00119 .00406 1.59 9.11 .33058 .95524 .00009 .00035 .89 
8.42 3.67602 .94114 00115 .00394 1.58 9.12 4.34013 .95540 -00008 .00034 .88 
8.43 3.68543 .94139 -00111 .00382 1.57 9.13 4.34969 .95557 -00008 .00033 -87 
8.44 3.69485 .94163 -00107 .00370 1.56 9.14 4.35924 .95574 -00008 .00031 -86 
8.45 3.70427 .94188 -00104 .00358 1.55 9.15 4.36880 .955 -00007 .00030 85 
8.46 3.71369 .94212 -00100 .00347 1.54 9.16 4.37836 .95607 -00007 .00029 84 
8.47 3.72311 .94236 -00097 .00336 1.53 9.17 38792 .95623 -00007 .00028 -83 
8.48 3.73253 .94259 -00094 .00326 1.52 9.18 4.39749 .95639 -00006 .00027 -82 
8.49 3.74196 283 -00090 .00316 1.51 9.19 4.40705 .95 -00006 .00026 -81 
8.50 3.75139 .94307 -00087 .00306 1.50 9.20 4.41662 .95672 -00006 .00025 -80 
Probit A w’ A w’ Probit Probit A w’ A w’ Probit 

Maximum response Minimum response Maximum response Minimum response 
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TABLE 1—Continued 


Minimum response Maximum omgenee Minimum response Maximum response 
A w A F 


Probit Probit A w A w 
4.42619 . .00006 . “ 9.61 4.81013 
-00005 .00023 
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Probit A x. w’ Probit A ' 
Maximum response Minimum response Maximum response Minimum response 


= 
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can be tabulated as well. To summarize, the four fundamental quanti- 
ties to be tabulated are: 








Minimum (r = 0) Maximum (r = n) 


Unit weight (w’) Z* ZY 4 Z? 

wei w ane an ammo bone poll 

ni g oS ae 
i — Z Z 
Unit weighted deviation (A) oo — 
Q P 


The equations (3) may then be rewritten in the new notation as: 
ba >, nw’ + 6b >> nw’X = Do nA 
da >, nw’X + 6b >. nw’X? = >> ndX. 


The computational labor in a single cycle then reduces to entering the 
values of w’ and A as functions of the provisional probits on a worksheet 
and proceeding to solve the two simultaneous linear equations. 








(4) 
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Table I presents the tabulation of A and w’, minimum and maximum, 
for probits from 5 to 10 with a constant interval of .01. Since the mini- 
mum A and w’ for a probit of X are the same as the maximum A and w’ 
for a probit of 10—X, the table may also be used for probits from 0 to 
5 by interchanging the minimum and maximum columns. Although it 
will not often be necessary, the table may be entered with probits to 
more decimal places with a maximum error due to linear interpolation 
of 4 in the sixth decimal place. The minimum A is always negative, but 
since it has been entered as positive in Table I, it should always be 
prefixed by a minus sign when transferred to a worksheet. 


2. An example 


Table II gives an illustration of the application of the present pro- 
cedure to Fisher and Yates’ example of the toxic effects of arsenic on 
brine-shrimps [7]. Two lines are used for each dose level. In column (2) 
the number not responding (survivors in the present example) is en- 
tered on the first line of each dose level, the number responding (deaths) 
on the second line. Columns (3) and (4) are as indicated. Column (5), 
the provisional probits, are those used by Fisher and Yates. The entries 
in (6) and (7) are copied directly from Table I, which is entered with 
the provisional probit. The minimum A and w’ are entered on the first 
line of each dose level, the maximum on the second. The minimum A is 
always prefixed by a minus sign. It is unnecessary to enter a value of 
A or w’ on any line in which the entry in column (3) is zero. Lines A-M, 
despite their formidable appearance, have been found to simplify the 
computation of m and b. They are not an integral part of the present 
method, however, and may be discarded by those who prefer other 
computational arrangements. The values of a and b which yielded the 
provisional probits in column (6) are entered on lines J and L. In the 
second cycle of computation the provisional probits are obtained from 
the line Y=.38+.70X and the process repeated. 

It is of interest to compare the results from the first cycle of calcula- 
tion with those obtained by Fisher and Yates. Such a comparison fol- 
lows: 














Provisional values 

Fisher and Yates, Ist cycle 

Present, Ist cycle 

Values after convergence* 6.609 

Percentage of distance between provisional and final 

values obtained by one cycle of calculation, 

Fisher and Yates 84 
Present 97 





* As given by Fisher and Yates. Garwood gives .7128 as the final value of b. 
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The present solution covers, as one would expect, a greater proportion 
of the distance between the provisional and final values. In the case of 
the estimate of the slope, the estimate obtained after one cycle of com- 
putation by Fisher and Yates differs from the final value by an amount 
equal to 15 per cent of the standard error of the slope, in the present 


TABLE II 


CALCULATION OF m, b, ¢n AND op BY USE OF A AND w’ 
Data from Fisher and Yates 








| Provi- 
sional 
probit 


Provi- 
sional 
probit 


Survivors 


(1) X(2) | (1) X(8) Cycle I Cycle II 


deaths 





f fX 
(2) (3) 


{X? ) Y w’ 
(4) (5) (8) (10) 





8 72 2.8 2.48 -0425 
0 0 — 





3.4 3.18 . 1497 





-3349 
-8144 


4.0 3.88 





4.6 -5352 


-7182 





-6932 
-5711 





64 , , ‘ m -7986 
-429 -3762 





0 ' _ — , —_ — 


648 - 163 +255 - 1020 -1818 



































First cycle Second cycle Computation of standard errors 





Arith- 
metic 
result 


Arith- 
metic 
result 


Arith- 
metic 
result 


Provi- 
sional 
values 


Provi- 
sional 
values 


Computa- 
tion 





= (2) (6) 
= (3) (6) 
= (2)(7) 


A=2/fA 
B=2ZfXA 
C= fw’ 


.388 
7.452 
21.905 


—.1617 
— .5531 
20.0721 


C/H 
vN 
1/C 


-02556 
. 1599 
.04982 


2 (3)(7) 
= (4)(7) 
AE-—BD 
BC-AD 
CE—D? 
F/H 
aot+l 
G/H 
bot+K 
(5—J)/L 





D=ZfXw’ 
E=ZfX*w’ 
F 

G 

H 





141.297 
961.669 
—679.818 
108.413 
1100.517 
— .6177 
.3823 
.0985 
.6985 











129.7857 
878.3183 
—70.2396 
9.8845 
785.3648 
— .0894 
-2906 
-0126 
-7126 
6.609 


D/C 

(M —Q)? 
P+NR 
vs 
T/L 














6.466 
-02045 
-05034 
-2244 
315 
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method, 9 per cent. The second cycle of computation yields the final 
values correct to four significant digits. 

In Table II the calculation of the standard errors of m and b is indi- 
cated in lines N through U. It is calculated only once from the final 
cycle. The calculation of the standard errors is identical with that of 
Bliss-Fisher, with w’ appearing in the present version wherever w ap- 
pears in the Bliss-Fisher version. No calculation of chi-square is shown. 
When it is required, it is most convenient under the present procedure 
to compute it directly from the definition, a procedure that is often 
necessary under the Bliss-Fisher procedure as well when the expecta- 
tions in some classes are small. 


3. An application to a slowly converging case 


In the previous example convergence was achieved after two cycles 
of computation. Finney in a recently published example [8] has con- 
sidered a case in which 4 cycles of computation were required. It is of 
some interest to compare the rapidity of convergence of the two meth- 
ods of computation in this case. The example has some unusual fea- 
tures since it involves fitting a probit plane rather than a line to 
responses at a series of dose levels, most levels containing only one 
subject. These special features have no effect on the special problem of 
convergence except for requiring estimates of two slope constants 
rather than one. 

Table III shows the results yielded by each method for each cycle of 
computation. Starting with the provisional estimates used by Finney, 
the present method yields essentially the same answers after three 
cycles of computation as those yielded by the Bliss-Fisher procedure 
after four. This result suggests that in cases in which the provisional 
estimate is poor the use of the present method may save a full cycle of 
computation. 

TABLE III 


COMPARISON OF RAPIDITY OF CONVERGENCE OF TWO METHODS 
Data from Finney 








Present Method Bliss-Fisher 





a b: 





Provisional estimate -1.8 
Cycle: 1 —6.1 
—8.65 
—9.198 
—9.2164 
—9.2164 























* Not included in Finney’s original article. 
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4. Common slopes and estimates of potency 


A very common application of the dosage response curve is in the 
estimation of relative potency. In these applications it is assumed that 
the tolerance distributions with respect to the two agents have different 
means but the same standard deviation. The relative potency of the 
second material to the first is then defined as y:/ye. The maximum 
likelihood equations defining the estimates of 41, 2 and o in this situa- 
tion are: 


Z,. 
$1 


ge 





(ris “= miPri) = 0) 





= =< + = 
(5) T —e~ Gu ~ tae) = 0 
1 Po; 2 
2 i BX ji ™ 
bm 7 50. a (rj —/ njiP ji) > 0 


j=l i=l j P5Q): 


and the application of Garwood’s procedure yields as equivalent to (4) 





8 $1 
dai >, M1 iW1;" + + 6b ; % Ny iW1i;' X15 
1 1 
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= > midi: 
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a2), NeiW2;' + 5b > NoiWe;’ Xo 
(6) 1 1 
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ia NiWii Xi + bar) N2iWai ‘X2i + 5b > > njiwyi X Pr 


‘=1 i=l] 
2 8j 
= pos >> NA jiX ji. 
1 1 
As an example of the application of these equations we have con- 
sidered an experiment of Eagle’s [9]. In this experiment three different 
groups of rabbits were injected with lethal doses of 6-hemolytic strepto- 
cocci. Group 1 was immediately injected with varying doses of peni- 
cillin; group 2 was injected with varying doses after a lapse of 13 hours; 
group 3 after 6 hours. The purpose of the experiment was to determine 
the effect of lapse of time on the curative dose required. 
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The calculations are shown in Table IV. The entering approxima- 
tions were derived from Karber’s method, as described in the next sec- 
tion. The computations are a straightforward generalization of the 
simpler case and require no comment except for noting that all compu- 
tations concerned with the common slope (+H, > J, etc.) are entered 
in parenthesis in the center column. The standard errors of the indi- 
vidual m’s are shown rather than the standard errors of the difference 
of two m’s. For any single potency comparison the variance of the 
difference of two m’s is given by 


Vim — M2) 


1 
ry [1/ >> fiwi’ + 1/ Do fowe’ 
+ V(b) (Xe = Xi — Mm, + m,)?| 


1 
rz [Ri + Re + P(S2 — Si — O2 + 0,)?]. 


III. KARBER’S METHOD AND INITIAL APPROXIMATIONS 
1. Observed responses from O to 100 per cent 


Despite the more rapid convergence of Garwood’s procedure, it is 
still necessary to begin with accurate approximations. When large num- 
bers of animals are used, graphic approximations will be quite accurate 
and, in fact, may eliminate the necessity for a maximum likelihood 
solution itself. With small numbers of animals at each dose level such 
approximations may be inaccurate, however, and in consequence sev- 
eral cycles of computation may be required before convergence is 
achieved. 

The use of a simple approximate method of sufficient generality to 
be widely applicable would therefore be useful in work with small num- 
bers of animals. For this purpose, Karber’s method provides a con- 
venient starting point. As considered by Irwin and Cheeseman [4] the 
method was used to provide estimates of the EDso alone. It has since 
been extended by Epstein and Churchman [2, 3] to include all higher 
moments as well. Of these only o need concern us here. Under circum- 
stances in which there are s doses equally spaced logarithmically, the 
number of animals at each dose level is equal and the observed re- 
sponses go from 0 to 100 per cent, this method gives as estimates: 


(7) m = X, — d(S; — 1/2) 


1 
7 = d?(2S2 ‘id Si ini S? a 1/12) 
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TABLE IV 


ESTIMATES OF m AND b IN THE CASE OF COMMON SLOPE 
Data from Eagle 








(1) X(2) | (1) X(8) 





fX fx? 





(4) 











Noareowwoeacdca 











64 
32 


150 














Aooeonrooeoca 


245 








6 hours 





245 


384 


Noo CRN eK AON KROSS 


























* Provisional Probit 
0 hrs. Y= 1.83+X 
13 hrs. Y= .83+X 
6 hrs. Y = —5.33+X 
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TABLE IV—Continued 








Designation 


Computation 


0 hours 


1} hours 


6 hours 





A=Z/fA 
B=2ZfXA 
C=Zfw’ 
D=f/Xw’ 
E=2ZfX*w’ 
P 

qa 

H 


I 


= (2)(6) 
z (3)(6) 
 (2)(7) 
= (3)(7) 
2 (4)(7) 
BC-AD 
CE—D? 
F/C 
=H 
a/c 

21 
2H/zI 
bo+J 
A-DJ 


— .6236 
— 1.6552 
10.292 
33.864 
123.188 

4.0823 
121.0804 
-3966 


11.7645 


— .3533 
2.5825 
8.706 
34.889 
146.901 
34.8095 
61.6779 
3.9983 
(2.2530) 
7.0845 
(31.2702) 
(.0720) 
(1.0720) 
—2.8653 


- 5274 
3.2344 
11.214 
114.315 
1177 .743 
—24.0192 
139.2908 
— 2.1419 


12.4212 


— 7.7033 


— .6869 
— 6.0169 
10.2769 


L/c : — .3291 
aot+M .5009 
(5—M)/K 4.1969 
1/21 (.03198) 
VP (.1788) 
1/¢c .1149 .08917 
D/C : 4.0075 10.1940 
(O-S)! .0359 .0069 
R+Pr .1160 .08939 
VU .3406 .2990 
V/K .3177 .2789 

















log dose at highest dose level 


interval between successive log doses 


Si= Do pi 
1 


S: > > Di 


j=l im] 


1/12 = Sheppard’s correction 
pi = per cent responding at ith dose level. 


As Table V indicates these estimates may be obtained simply and 
rapidly. These values are far more accurate than the provisional values 
used by Fisher and Yates and are in fact almost as accurate as those ob- 
tained after one cycle of computation by use of the Bliss-Fisher pro- 
cedure. When the method proposed in Section II is used with pro- 
visional probits based on the results of Karber’s method, the estimates 
of m and b obtained after one cycle of computation are 6.609 and .7127. 
These differ from the final values by .000 and .0001 respectively. 
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TABLE V 


APPLICATION OF KARBER’S METHOD EXTENDED TO THE ESTIMATE OF m AND 5 
Data from Fisher and Yates 








Cumulated per cent 


Per cent mortality mettelite 





(pi) 

0 0 

0 0 

.250 .250 

.375 -625 

.375 1.000 

.875 1.875 
1.000 2.875 


2.875 =S, 6.625 =S; 





m =9 —1(2.875 —}) =6.625 
1 
b= =.7025 
1[2(6.625) —2.875 — (2.875)? —.0833}!/2 








A more extensive check of this procedure is indicated in Table VI. 
The data used are the ten samples of 5 mice at each of 7 dose levels 
published by Irwin and Cheeseman. The m’s by Karber’s method and 
the m’s and b’s by maximum likelihood are as given or derived from 
results given by Irwin and Cheeseman.‘ 

The b for Karber’s method has been computed by us, as have the 
first cycles of computation according to the method of Section II. It 
will be seen that the maximum difference between the final value and 
that obtained after one cycle of computation is .005 for m and .02 for b, 
and average less than 1 per cent of the standard errors. It would appear 
therefore that in many situations in which Karber’s method is applica- 
ble, a combination of it and the method of Section II will yield satis- 
factory approximations to the maximum likelihood estimates with one 
cycle of computation. 

Karber’s method can still be applied when doses are not equally 
spaced, or numbers of animals are not equal. In the more general case 


. Xi t+ Xin 
m i # (pi — Di-1) (=) 


(9) 1 


>> (pi — pi-1) 


eo oS 





4 It should be noted that the maximum likelihood estimate of m for sample A is given by Irwin and 
Cheesemanas 2.246, and by Garwood, for theonly one of the 10 samples which he checked, as 2.243. There 
may consequently be some doubt about the last digit in the maximum likelihood estimates of Table VI. 
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where k is Sheppard’s correction 





_ >» (pi = pi-1)(X; — Xi)’ 
7 12 

mi =0 

p: = 1. 

TABLE VI 


COMPARISON OF ESTIMATES OF m AND 6 OBTAINED BY THE USE OF KARBER’S 
METHOD AND THE METHOD OF SECTION II WITH THE FINAL 
MAXIMUM LIKELIHOOD SOLUTION 








Kirber’s Method of Final maximum 
- Section II* likelihood 
one cycle solution 


i t 
mapanmnen method 





At 2.3 2.243 2.246 
-885 -863 -864 


2.9 .809 2.811 
-625 -581 - 582 


2.9 -979 2.977 
-859 .818 .819 


2.1 -010 2.007 
1.022 -983 -984 


-128 
.367 


-862 
-062 


. 138 
-022 -062 


2.3 -215 
772 -737 -737 


3.9 -910 
625 -645 -646 


Kt 2.5 2.477 
-946 -883 -883 





Note: Values of m shown are in terms of dose number, the lowest dose having a value of 1, the 
seventh a value of 7. Values of b are in terms of probits per unit increase in dose number. Final maximum 
likelihood solutions shown are as given or derived from results given by Irwin and Cheeseman. There 
is a possible rounding error of 2 in the last place shown in the values of m given by the final maximum 
likelihood solution due to changing from logarithms (to the base 10) to dose number. 

* Entering values for m used are as shown under Karber’s method. Entering values for b were some- 
what less than those shown as no correction for grouping (Sheppard's correction) was made at the 
time. This results in some cases in poorer estimates after one cycle by the method of section II than 
would otherwise have been obtained. 

t No zero mortality observed at lowest dose. Karber’s method is used by imputing a next lower 
dose giving zero mortality. This results in over-estimating m and b. 
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To illustrate the application to this case we may return to the example 
of Finney’s considered earlier. Finney’s provisional estimates were ob- 
tained by combining his original data into equally spaced but over- 
lapping dose levels from which he estimated his provisional line. The 
data are: 








Dose level Response 





1.5-1.9 0/7 
1.5-2.0 0/7 
2/7 
2/9 
3/14 
8/19 
13/24 
17/25 
16/17 
12/12 


ePeP ees 
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NNNNN eee 


>, 





So long as dose levels are equally spaced as they are in this case, the 
equations (9) reduce to (8) and we may estimate m and b from S, and 
Se. S; and S; are equal to 4.30 and 14.30 respectively, from which we 
may estimate a= —4.26, and b=4.17. These are considerably better 
than Finney’s provisional estimates (Table ITI). 

As Finney points out, however, the grouping device leads to under- 
estimation of the regression coefficient, so that it should be possible to 
obtain better estimates by using the individual data.’ One cannot, of 
course compute the empirical probits on this basis since the only possi- 
ble individual responses, 0 or 100 per cent, would yield infinite probits. 
Karber’s method is not subject to this limitation. 

Table VII shows the basic calculations. The first column gives log 
dose, the second the response. No response is indicated by a minus, a 
response by a plus. Where there is more than one subject at a dose 
level, the numerator of the fraction indicates the number responding, 
the denominator the number exposed. p;—pi-1 is indicated only when 
two successive dose levels show different responses, since it is equal to 
zero when they Go not. The calculation of a and b in accordance with 
(9) is then quite simple. (With only one at a dose level the calculations 
would simplify still further.) The estimates of a and b obtained are 
—6.78 and 5.31. These are not only superior to the estimates used by 
Finney; they are slightly better than the results of the first cycle of 





5 Or alternatively, Karber’s method could have been used with the original observations in equally 
spaced, but non-overlapping groups, there being no need to have “smoothed” responses for the purpose 
of drawing a line. 
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Garwood’s procedure using Finney’s provisional estimates as the start- 
ing point. Thus, despite the fact that the optimum conditions for 
Karber’s method, equal spacing and equal numbers of subjects per dose 
level, are not met, it appears that the joint application of Karber’s 
method and the method of Section II yields better estimates after two 
cycles of computation than Finney obtained after four. 


TABLE VII 


USE OF KARBER’S METHOD TO ESTIMATE m AND 6b WHEN DOSE LEVELS ARE 
NOT EQUALLY SPACED AND THE NUMBER OF ANIMALS IS UNEQUAL 








Log dose Response pj —Pi-1 Xi+Xiu (X45 +X 5-1)? (X; —Xi-1)? 





(1) (2) (3) (4) (5) (6) 





.60, 1.6 
.83, 1.8 


3. 
2. 
2. 
2. 
2. 
2. 
2. 
2. 
2. 
2. 
2 
2. 
2. 
2. 
2. 


aS 
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16.1604 


17.5561 


19.7136 


20.5209 


21.2521 
21.4369 
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ieee +Xj-1 
m = =(pi — pi-2) =42(3)(4) =2.2175, m? =4.91731 


= by 2 (ps —pi-1) (Xi — be = py2(3) (6) =.00085 
arr - 
= =(pi —Pi-)) —m? —k =}2(3)(5) —m? —k =4.95356 —m? —k =.03540 


b? =28.25 b=5.3 a =5—mb = —6.78 


The estimates of m yielded by Karber’s method are calculated inde- 
pendently of the estimates of b. In consequence relative potency can 
be estimated using this method without the necessity of calculating a 
common slope. When the assumptions on which Karber’s method is 
based are satisfied this is true of the probit method as well, since the 
estimates of relative potency and their variances are much the same 
whether individual or common slopes are used. As Table VIII indicates, 
the relative potency estimates from the m’s furnished by Karber’s 
method and the probit method, using both individual and common 
slopes agree closely. Strictly speaking, however, when log potency is 
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computed as the difference of the m’s estimated by Karber’s method, 
it is necessary to estimate the separate o’s and test the significance of 
their difference even though it is not necessary to estimate a common «. 


TABLE VIII 


COMPARISON OF m’s, ED 50's AND STANDARD ERRORS OBTAINED BY KARBER'S 
METHOD WITH THE MAXIMUM LIKELIHOOD SOLUTION 
Data from Eagle 








0 hours 1} hours 6 hours 





m+S.E. (Units of X in Table IV) 
Karber’s method 3.250+. 4.167+ .211 10.333 + .341 
Maximum likelihood 
Individual slopes 3.234+. * 10.303 + .335 
Common slope 3.235+. 4.197+ .318 10.277 + .279 


EDs.+8S.E. (mg /kg.) 
Karber’s method .297 + .069 -561+ .082 40.34+9.5 
Maximum likelihood 
Individual slopes .294+ .062 * 39.5+9.2 
Common slope .294+ .059 .573 + .126 38.8+7.5 





Calculations for Karber’s method and maximum likelihood individual slopes not shown. Common 
slope values are based on the results of Table IV. 
* Maximum likelihood procedure does not converge for this case. 


2. The theoretical basis of Kdrber’s method 

The uniformly excellent approximations to m and b obtained with 
Karber’s method suggest the possibility of deriving the method itself 
directly from the maximum likelihood equations by means of one or 
more simplifying assumptions. If in (2) we assume that (n;Z;/P;:Q;) is 
constant at all dose levels, the equations reduce to: 


» Pi = > P: 
1 1 


(10) 


2. X ipi = > XP,. 
1 1 


If the underlying distribution of tolerances is log logistic and the num- 
ber of animals at each dose level is equal, this simplification is exact. 

Although the population parameters » and o?(=1/8?) are defined as 
integrals, we may, using Sheppard’s correction (k), rewrite them as: 





6 In what follows it is assumed that P1=0 and P, =1. For finite doses this is inconsistent with the 
assumption of a log normal or log logistic distribution. Strictly speaking we should treat P: =e, and P; = 
1 —e, where €is sufficiently close to zero to have no effect on subsequent calculations. 
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ad Xi; ; o- 
w= > (Pi — Pr») (55) 
ian? 


1 - Xi | or 2 


vb t=2 


(11) 


Taking advantage of the fact that the intervals are equally spaced, we 
may write this as 


d 
w= Xi +> -— dd Pi 
(12) 


o“~ a {ale + DEP. —- Lap.) —- EP. - (SPY -<\. 


Using the notation of (8) and noting that the second maximum likeli- 
hood equation can be rewritten as )-ip;= )_7P; when the intervals are 
equally spaced, (10) and (12) together yield as maximum likelihood 
estimates under the stated conditions: 


p= m=X.+2-d5 
(13) ' 
B 
Equations (13) and (7) are of course identical. Karber’s method conse- 
quently provides the maximum likelihood solution when the following 
conditions are satisfied :’ 
(a) equal numbers of animals at each dose level 
(b) equally spaced intervals 
(c) an underlying log logistic distribution of tolerances 
(d) » and o of the population are defined in terms of a frequency dis- 
tribution with finite class intervals rather than an integral with 
infinitesimal class intervals 
(e) P,:=0, P,=1. 
An identical process of reasoning, starting with the equations (5) yields 
as maximum likelihood estimates of relative potency, when conditions 
(a)—(e) are satisfied, an equally simple procedure. The results are sum- 
marized in Table VIII. 


7? This conclusion should be contrasted with Finney’s statement [1, p. 28] that Karber’s method de- 
pends on the assumption of a linear relationship between P (rather than the probit of P) and log dose. 
Finney was apparently thinking of the linear approximation used by Irwin and Cheeseman to estimate 
the variance of m rather than the assumptions necessary to derive the Karber estimate of m itself. 
Thompson’s criticisms of Karber’s method [10] are believed to be covered by the preceding footnote. 


1 1 
== rt = i(2s, - 8, - 8 -<), 


12 
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Of the assumptions only (e) is necessary to the application of 
Karber’s method but (a)-—(e) must be satisfied if that application is to 
yield maximum likelihood estimates. So long as (e) is satisfied, the esti- 
mates of m and b yielded by both Karber’s method and the probit 
method are estimates of the same parameters. 

Several authors have pointed out that the logistic and cumulative 
normal curves are very similar and Pittman and Lieberman have 
shown [11] that even under practical experimental conditions estimates 
obtained from either assumption agree very closely. Since both assump- 
tions are idealizations and Geary’s comment “Normality is a myth; 
there never was and never will be, a normal distribution” [12] could be 
applied equally well, to any other frequency form, most investigators 
will be content to choose between them on practical grounds. 

It should be pointed out that condition (d) introduces as great a 
simplification in the estimation of the mean and standard deviation 
when individual measurements are available as it does in the case of 
quantal responses. The maximum likelihood estimates of yu and a for 
grouped nonquantal data, the case usually treated in elementary sta- 
tistical texts, are [13]: 

pM r; (C4) = 0 
t=] P; 
(14) 





> m XZ; - maa) 


inl P; 


These equations are as difficult to solve as (2).§ Any objections to the 
simplification involved in condition (€) imply equal objections to the 
usual methods of estimation for grouped data. 


3. The expected values of the estimates of u and a? 


Up to this point we have considered Karber’s method from the point 
of view of the probit method. The results of the preceding section sug- 
gest that either method is an excellent approximation to the other be- 
cause both are maximum likelihood estimates under not too dissimilar 
circumstances. It is well known however, that the maximum likelihood 
criterion may lead to biased estimates for finite samples. A direct in- 
vestigation of the biases in the estimates of u and o? provided by the 
probit method does not seem feasible. The estimates are non-linear 





8 While the calculations involved in the maximum likelihood solution are not trivial, the burden of 
computation can be exaggerated. In our experience, all but the simplest analysis of variance problems 
involve a good deal more calculation. 
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functions of sample observations, and an estimate of bias obtained by 
expansion in series with a term by term evaluation of bias might intro- 
duce errors of approximation of the same order as the biases to be 
investigated. In the case of Karber’s method, however, the estimates 
are linear functions of the sample proportions. For this case it is possible 
to derive exact corrections. From (9) we may write, 


- D (p - Di-1) (— =) 


: X; + Xi-n 
E(m) = > (Ep: - Ep.) (== ) 


in? 
Xi +X = 


= (Pi - Pia) 3 


By (11) however, (15) is the expression for u, the mean of the parent 
population. Whenever P;=0 and P,=1, therefore, m provides an un- 
biased estimate of u. We may also write from (9): 


1 Xi t+ Xi-s 2 
B(—) - E(*) = EX, (pi — pi- v(= = - m) 


” X;+ Xi\? 
~ } i (P; — Pi-1) (= , =) — Em? 


Se - nsf 








X, + X.- Xint — Xie 
= a) —_ (X, + X.)>> p.( = 2 ) 
—— 
2 t+1 ry ) 
+ Do ps (- ‘ 
Xin — Xi-n\ (Xin — *22) 
+d prs( 2 )( 2 


ij 


Em? - yu? + } =e ‘+1 ™ ==), 


m? = | 
[Ey r0 2] 
(e585 











2 
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From (17) and (16) we find 





P a - ==!) 
; ; 


Ni 


(18) E(@?) = 0? — >> 


(18) indicates that the estimate of co? supplied by the maximum 
likelihood equations under the conditions in which Karber’s method is 
applicable underestimates the true value by an amount equal on the 
average to 

PQ: (= - ==!) 
Ns 2 


2 


This is the same as the result given without proof by Churchman and 
Epstein. To obtain unbiased estimates of o? it is necessary to add to (5) 


the value 
PQ: (= _ ==) 
2 


Ni 





> 


P,Q; however, represents a population value which is in general un- 
known. We must consequently substitute for it an unbiased estimate 
based on sample values. On this basis, in the case of equal spacing and 
equal numbers of animals, we have as an unbiased estimate of o? 





1 P:Qi = | 
19 a eR, By et 
(19) 5? | 2 1 v?+> aa 


with a similar expression for the more general case. At any dose level 
containing only one animal piq:/(n:—1) becomes indeterminate. In such 
cases it is necessary to estimate P:Q; by other means. 

Table LX shows the effect of this bias correction on the estimate of 
slope for the ten samples considered by Irwin and Cheeseman.® On an 
average the probit method and Karber’s method provide estimates of 
the slope differing by .008 or only 3 per cent of the standard error. The 
bias correction to Karber’s method averages 14 per cent of the stand- 
ard error, however, and suggests that the probit method yields an esti- 
mate with a bias of like amount. In the case of the Fisher-Yates ex- 
ample the bias in the Kiarber estimate of b is .0181 or more than 10 
per cent of the standard error. 

The demonstrated bias in the Karber estimate of b would appear to 
apply to the probit estimate as well. Under conditions in which 
Kiarber’s method is applicable it differs from the probit method in only 





® (19) provides an unbiased estimate of o?, but a biased estimate of o or 1/c, just as division by 
n—1in the case where individually measured responses are available provides an unbiased estimate of 
o*, but a biased estimate of c. 
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TABLE IX 


EFFECT OF BIAS CORRECTIONS ON THE ESTIMATE OF SLOPE 
Data from Irwin and Cheeseman 








Karber’s method Standard error 
with bias maximum likeli- 
correction hood estimate 


Maximum Karber's 
likelihood method 





A* .864 .885 .834 .291 
B* .582 j .604 

Cc .819 .859 834 

D* .984 .022 .992 

KE .385 .340 .234 

F .074 .022 .973 

G .071 .022 .973 

H* .737 772 

J .646 625 

Ke .883 





Average .904 -912 








* No zero mortality observed at lowest dose. Kiarber’s method is used by imputing a next !ower 
dose giving zero mortality. 


two respects, one assumes grouped data and a log logistic tolerance 
distribution, the other ungrouped data and a log normal distribution. 
Both are maximum likelihood estimates. The difference with respect to 
grouping is taken care of on an average by Sheppard’s correction and 
can be disregarded. No matter what the underlying distribution is, 
however, the variance of the population is uniquely defined. The exam- 
ples of the previous pages show that both methods provide estimates of 
the same population parameter. The present section has shown that in 
the case of Karber’s method this parameter is not the population vari- 
ance. Hence the probit method does not provide an estimate of the 
population variance, either. A demonstrated bias in one is a demon- 
strated bias in the other. Different assumptions with respect to the 
underlying distribution will affect the weights used in making the esti- 
mate, and hence the efficiency of the estimate, but they will have no 
effects on the expected values. 

The extension of the bias correction to the probit method when the 
number of cases is unequal, doses are not equally spaced, and the lowest 
and highest doses do not represent 0 and 100 per cent response is diffi- 
cult. The bias correction for the estimate of o? in the case of Karber’s 


method is Q s 
PQ: (Xin — Xin\’ 
> ( ). 
nN; 2 





This, however, is the sampling variance of m (see pp. 207). Similarly, 
if we compute the variance of a sample yielding individual measure- 
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ments by dividing by n, this can be made an unbiased estimate of the 
population variance by adding to it o?/n, the sampling variance of the 
mean. When the true variances are unknown we can obtain unbiased 
estimates in each case by adding unbiased estimates of the sampling 
variance of the mean, 


Pai (Xin — Xin\? 
eae, alee mae 


n; — 1 





in the first case, s?/(n—1) in the second. Finally, in both cases if the 
true mean is known and is used to estimate o?, the resulting estimates 
are unbiased and require no correction. 

This argument suggests that a general correction to 1/b? might be 
obtained by adding to it V(m). This procedure should be adequate 
when the dosage range covers 0 to 100 per cent but may not be ap- 
propriate in the truncated case. Even if we adopt this procedure as at 
least approximately correct, there is no way of applying it exactly, 
since the algebraic expression for V(m) in the general case is an approxi- 
mation, and will be least satisfactory in those very cases in which a bias 
correction is most required. Furthermore, the estimate of V(m) com- 
puted from the sample is not unbiased. In addition there are finite 
probabilities of obtaining samples which yield zero, negative or infinite 


slopes, which further complicates the matter, since most investigators 
would reject such samples. The entire question requires systematic in- 
vestigation. 


4. The variance of m and b 


Because there may be circumstances in which the estimates yielded 
by Karber’s method can be used not merely as first approximations but 
as final estimates, it is useful to have expressions for the variances of 
the estimates appropriate to the approximations inherent in the form 
of estimate.!° 





10 The general principle that a variance should be appropriate to the estimator being used rather 
than to the ideal estimator being approximated is an obvious point that is sometimes overlooked in the 
applications of statistics to bio-assay. Thus, in methods which estimate the probit line by graphical 
means, the variance actually used is that appropriate to the maximum likelihood estimate being ap- 
proximated [14]. Such graphic estimates however are subject not merely to the error of the maixmum 
likelihood estimate but to the additional errors inherent in the process of graphic approximation. Analy- 
sis of the results of Litchfield and Fertig indicates that for the log ED 50 the average error due to the lat- 
ter source is at least 60 per cent of that due to the former, so that variances yielded by this method should 
be increased by at least 36 per cent on this account. The efficiency of the method in estimating the log ED 
50 is consequently about 70 per cent, although the standard errors used imply an efficiency of 100 per 
cent. For the estimate of the slope the situation is similar. The factor of 1.36 derived from the data of 
Litchfield and Fertig depends upon all those influences which affect the accuracy of the graphic fit, such 
as the skill with which the line is drawn and the size of sample. It will consequently vary from problem 
to problem and analyst to analyst. 





VaTTs + 


| 


DOSAGE RESPONSE CURVE 
For the general case we may write 


n= > (pi — Di-1) (= ===) 


tan? 


X,- ) on" (- i+1 ™ =) 








Xian — Xiun\? 
V(m) = z( ee ) V(pi), 
since the p; are independent 


Xian — Xin\? Pi 7 
(20) =, ) : 





nN; 
Similarly 2 * ’ 
tt Awe a m) 


éu2 = Do (pi — p.s)( rs 


4 > PiWi (== = ==) - k 
_ = 1 2 





where k is Sheppard’s correction. 
To a first approximation 
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Equation (21) provides an approximation to the variance of the un- 
biased estimate of o?. If we wish the variance of the biased estimate, 
which is equivalent to the estimate furnished by the method of maxi- 
mum likelihood, the same process of reasoning yields 


eres eis au PQ: 
—2Qu pal 





(22) V(és?)= >( 


2 2 


ni 
For equally spaced intervals of width d, (21) and (22) reduce to 
PQ; 


nN, 


V(m) = d? 


(23) 
PQ: 

V(és?) = 2d? >> (X; — uw)? — - 
The preceding expressions provide a basis for investigating the effi- 
ciency of Kiarber’s method under general circumstances and not merely 
for the case of equally spaced dose intervals with equal numbers of 
animals, for which circumstance it is known to possess a high efficiency 
even when a log normal distribution is assumed [15]. 

P,Q;/n; is in general unknown, but if we substitute for it in (20), 
(21), (22) and (23) piq:/(n:—1) we shall have an unbiased estimate of 
it. This procedure renders the estimate of V(m) exactly unbiased and 
applies a bias correction to V (é?) of the same order of approximation as 
the expression for V(é?) itself, i.e., it assumes m=uy. The use of the ob- 
served p;, in addition to simplicity of calculation, has the additional 
virtue of making no assumption about the form of the tolerance dis- 
tribution. If any particular form can be safely assumed, however, the 
smoothed P; implied by that form will, when inserted in (20) and (21), 
yield more efficient estimates of the variances. 


5. The truncated case 


The only limitation on the application of Karber’s method is that 
observed responses run from 0 to 100 per cent, or, more generally, that 
it can be safely assumed that the dose level below the lowest in the 
experiment or above the highest would always yield 0 or 100 per cent. 
Experiments in which this condition is not satisfied are common, how- 
ever, and in many cases it would be inefficient to design them so that 
they did. Karber’s method can be extended to cover the case of trunca- 
tion, but the resulting equations involve P and Z at the points of trun- 
cation. They can be solved only by iteration and when the truncated 





DOSAGE RESPONSE CURVE 209 


area is large the solution converges quite slowly. The method seems to 
offer no advantage over the method of Section II. 

A more direct approach to this same objective, and one with a 
simpler answer, can be found by rewriting (2) after assuming n:Z;/P:Q; 
is a constant, but making no assumption with respect to X;. We obtain 


Lp = > P; 
> piXi - > PX. 


The estimates of m and b depend on only two quantities, >>p; and 
>> p:X;. In consequence, all experiments which use the same dose levels 
and supply the same values >>p; and > >p;X;, will furnish the same 
estimates of m and b. This indicates the possibility of preparing a set of 
tables which are entered with >> p,; and >> p;X; and from which m and 
b are read. Such tables would provide the maximum likelihood solution 
on the assumption of a logistic distribution. If the tables were restricted 
to the case of equally spaced dose levels with equal numbers of animals 
at each dose, a single table for each possible number of dose levels 
would suffice. Tables covering 3 to 10 dose levels would cover most 
ordinary situations. The tables could probably be most easily calcu- 
lated, as suggested by Wilson and Worcester [16], by starting with 
assumed values of m and b and calculating from them )-P; and 
>P:X ;. Since these are by (24) equal to >>p; and >> piXi, an inver- 
sion of the table resulting from this procedure will yield the desired 
table. The variances can be calculated on the same principle. A pre- 
liminary investigation of the calculations involved indicates that the 
project is entirely feasible. If the further work we plan confirms this 
conclusion, the statistical calculations required in many bio-assay prob- 
lems can be reduced to about the order of difficulty of looking up a 
logarithm. 


(24) 
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PROBABILITY VALUES FOR THE COMMON 
TESTS OF HYPOTHESES* 


T. A. BANcRorT 
Statistical Laboratory, Iowa State College 


Sources and formulas for obtaining probability values for 
the common tests of statistical hypotheses are listed with an 
indication of the scope and utility of each. Examples are given 
which illustrate methods of calculating probability values 
outside the range of available tables for a large group of im- 
portant tests. 


1. INTRODUCTION 


FTER calculating a test criterion or statistic to be used in testing an 
hypothesis one may wish to know the probability of obtaining a 
value or absolute value equal to or greater than the calculated value, 
on the assumption that the hypothesis tested is true, rather than simply 
knowing whether the probability exceeds or is less than .05 or .01. The 
latter information may be readily obtained from tables available in 
most texts on statistical methods. Specific probability values in general, 
however, may be obtained only from more extensive tables which often 
require training to be used effectively by the applied statistician. Again, 
even such extensive tables may be limited in usefulness due to the 
limited range of values of the parameters involved.! 

The objects of this paper are: (a) to list sources and formulas in 
usable form for obtaining probability values for the common tests of 
hypotheses, (b) to indicate the scope and utility of each, and (c) to 
demonstrate by worked examples, using formulas derived by the 
author, how to obtain probability values outside the range of available 
tables for a large group of important tests. 


2. CHI-SQUARE TEST 


(a) R. A. Fisher and F. Yates, Statistical Tables for Biological Agri- 
cultural and Medical Research, Oliver and Boyd (1938). Table IV. The 
range of the degrees of freedom n is 1(1)30 and for P is .99, .98, .95, .90, 
80, .70, .50, .30, .20, .10, .05, .02, .01, and .001. The entries in the body 
of the table are three decimal place chi-square values corresponding to 
particular values of n and P. The chi-square values for n=1, P=.99, 





* Journal Paper No. J-1785 of the Iowa Agricultural Experiment Station, Ames, Iowa. Project 
No.8 1. 

1 The exact probability values for each of severe! independent significance tests are needed if one is 
to compound the probabilities from such tests (see Wallis. W. A., “Compounding of Probabilities from 
Independent Significance Tests,” Econometrica, Vol. 10 (1942), p. 229, for a discussion of this problem). 
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.98, .95, .90 and .80 and n=2, P=.99 and .98 have of necessity been 
taken to three significant figures rather than three decimal places. A 
crude approximation of P(x?2 xo?) for non-tabled values of P may be 
obtained by inverse interpolation. 

(b) Catherine M. Thompson, Table of Percentage Points of the x? 
Distribution. Biometrika, Vol. 32 (1941-1942). The range of degrees of 
freedom »v is 1(1)30; 30(10)100 and for P is 0.995, 0.990, 0.975, 0.950, 
0.900, 0.750, 0.500, 0.250, 0.100, 0.050, 0.025, 0.010 and 0.005. The en- 
tries in the body of the table are chi-square values to six significant 
figures corresponding to the particular values of vy and P. Inverse inter- 
polation may be used as in 2(a). 

(c) Karl Pearson, Tables for Statisticians and Biometricians. Cam- 
bridge University Press (1924). Table XII. The range of the degrees of 
freedom n =n’ —1 is 2(1)29 and that of chi-square is 1(1)70. The entries 
in the body of the table are six decimal place probability values corre- 
sponding to particular values of n’ and chi-square. P(x?= xo”) for non- 
tabled values of xo”, within the respective ranges of n and xo”, may be 
obtained by interpolation. 

(d) Karl Pearson, Tables of the Incomplete T-function, H. M. Sta- 
tionery Office (1922). P(x?2xo0?)=1—I(u, p), where u=x0?/2V/p+l, 
p= (n/2)—1, and n=degrees of freedom for xo?. The range of u is 0(.1) 
up to that value of u which gives I(u, p) =1.000,0000. The range of p 
is —1.0(.05)1.0, 1.0(0.1)5.0, and 5.0(0.2)50.0. The entries in the body 
of the table are seven decimal place values of the incomplete gamma 
function ratio corresponding to particular values of u and p. For in- 
tegral degrees of freedom interpolation will be necessary only for non- 
tabled values of wu. A convenient general 4-point and 6-point interpola- 
tion on page xlvi of Karl Pearson’s Tables of the Incomplete Beta Func- 
tion is referred to later. 


3. t-TEST 


(a) Fisher and Yates’ Tables referred to above. Table III. The range 
of the degrees of freedom n is 1(1)30 and the additional values 40, 60, 
120, and «. The range of the values of the probability P is .9(.1).1 and 
the additional values .05, .02, .01, and .001. The entries in the body of 
the table are three decimal place t-values corresponding to particular 
values of n and P. These tables have been reproduced in many texts on 
statistical methods. Inverse interpolation may be used as in 2(a). 

(b) “Student,” Metron 5, 1925. These tables are reproduced in M. G. 
Kendall’s The Advanced Theory of Statistics, Volume I, Charles Grif- 
fin Co. (1943). The range of the degrees of freedom » is 1(1)20, and 
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for t is 0(0.1)6.0. The entries in the body of the table are three decimal 
place probability values corresponding to particular values of » and ¢. 
P(|t| to.) =2(1—P) or P(t2t.)=1—P where P is the entry in the 
table. Univariate interpolation, referred to above, for non-tabled values 
of t and tabled values of vy may be employed. 

(c) Maxine Merrington, Table of Percentage Points of the ¢-Distribu- 
tion. Biometrika, Vol. 32 (1941-1942). The range of degrees of freedom 
y is 1(1)30 with the additional values 40, 60, 120, and . The range 
of the probability P is .50, .25, .10, .05, .025, .01 and .005. The entries 
in the body of the table are ¢-values to five significant figures corre- 
sponding to the particular values of v and P. Inverse interpolation may 
be used as in 2(a). 

(d) Elizabeth M. Baldwin, Table of Percentage Points of the ¢-Dis- 
tribution, Biometrika, Vol. 33 (1943). Extension of the table described 
in 3(c) when v>30. The range of v is 1(1)30, 32(2)100. The range of P 
is .05 and .01. The entries in the body of the table are three decimal 
place ¢ values corresponding to the particular values of v and P. 

(e) Karl Pearson’s Tables of the Incomplete Beta Function, Cam- 
bridge University Press (1934). In using the table to obtain P(|t| 2 to) 
or P(t=to) the t) value would be transformed to the Incomplete Beta 
Function Ratio, I.,(p, q). Usable transformation formulas and worked 
examples are given in the Introduction to the Tables. The Tables give 
values of J,,(p, g) for p, g=.5(.5)10.5, 11(1)(50) and 2) =.01(.01)1.00. 
An adequate 6 or 4 point univariate interpolation formula for obtaining 
non-tabled values of 2 within its range is the same as that referred to 
above. This formula is easy to apply and also provides a measure of the 
accuracy obtained in using it in an abbreviated form. Methods of 
interpolating for non-tabled values of p and gq will not be necessary 
except for the half values of p after p=10.5. Bivariate interpolation 
formulas are given in the Introduction, but are on the whole found 
difficult to use by the ordinary worker in applied statistics. 


4. F-TEst 


(a) P. C. Mahalanobis, Auxiliary Tables for Fisher’s z-test in Analy- 
sis of Variance. Indian Journal of Agricultural Science, 2: 694 (1932) 
Tables II and III. The range of n; degrees of freedom (for greater mean 
square) is 1(1)6 and the additional values 8, 12, 24, and «. The range 
of nz degrees of freedom is 1(1)30 and the additional values 60 and «. 
The values of F, designated by Mahalanobis as z, are tabulated to five 
significant figures for ne=1 and to three decimal places thereafter for 
the probability values .05 and .01. A crude approximation for proba- 
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bility values between these two may be obtained by inverse interpola- 
tion. 

(b) George W. Snedecor. Analysis of Variance and Covariance. Col- 
legiate Press, Inc., Ames (1934). Also reproduced in the author’s text, 
Statistical Methods, and in many other texts on statistical methods, 
The range of n; degrees of freedom (for greater mean square is 1(1)12 
and the additional values 14, 16, 20, 24, 30, 40, 50, 75, 100, 200, 500 
and «. The range of nz degrees of freedom is 1(1)30, 30(2)50, 50(5)70 
and the additional values 80, 100, 125, 150, 200, 400, 1000 and «. The 
values of F are tabulated, except for additional significant figure ac- 
curacy for ne=1 and 2, to two decimal places and for the probability 
values .05 and .01. Inverse interpolation may be used as in 4(a). 

(c) R. A. Fisher and F. Yates’ Tables referred to above. Table V. The 
range of n, degrees of freedom (for greater mean square) is 1(1)6 and 
the additional values 8, 12, 24 and «. The range of nz degrees of free- 
dom is 1(1)30 and the additional values 40, 60,120 and «. The values 
of F, designated by Fisher and Yates as the Variance Ratio, are tabu- 
lated to two decimal places except for the earlier values of n2, and are 
given for the probability values .20, .05, .01 and .001. Inverse interpola- 
tion may be used as in 4(a). 

(d) Maxine Merrington and Catherine M. Thompson, Tables of 
Percentage Points of the Inverted Beta (F) Distribution. Biometrika, 
Vol. 33 (1943). The range of », degrees of freedom (for greater mean 
square) is 1(1)10 and the additional values 12, 15, 20, 24, 30, 40, 60, 
120 and «. The range of v2 degrees of freedom is 1(1)30 and the addi- 
tional values 40, 60, 120 and «. The range of the probability P is .50, 
.25, .10, .05, .025, .01 and .005. The entries in the body of the table are 
F-values to five significant figures corresponding to the particular 
values of », v, and P. Inverse interpolation may be used as in 4(a). 

(e) V. G. Panse and G. R. Ayachit, Ten Per Cent Probability of z and 
the Variance Ratio. Indian Journal of Agriculture, Vol. 14 (1944). The 
range of n; degrees of freedom (for greater mean square) is 1(1)10 with 
the additional values 12, 15, 20, 24, 30, 40, 60, 120 and ~. The range 
of nz degrees of freedom is 1(1)30 with the additional values 40, 60, 120 
and «©. Only P=.10 is tabled. The entries in the body of the table are 
two decimal place F values. 

(f) Karl Pearson Table referred to in 3(e). In using the table to obtain 
P(F2F») the Fo value would be transformed to the Incomplete Beta 
Function Ratio, I,,(p, q). The discussion as to transformation and 
range of parametrs, etc. is the same as in 3(e). 
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5. ADDITIONAL TESTS 


(a) P(rSro), p=po is given directly in F. N. David’s Tables of the 
Correlation Coefficient, Cambridge University Press (1928). 

(b) P(r2ro), p=0; P(R?2Ro*), p=0; and P(T?2T»o*) may be ob- 
tained, for certain values of the parameters involved, by transforming 
to the Incomplete Beta Function Ratio, I,,(p, q) and using Pearson’s 
Tables referred to in 3(e). Worked examples may be found in the Intro- 
duction to the Tables. 


6. OBTAINING VALUES OF I,,(p, g) OUTSIDE THE 
TABULAR VALUES OF Pp AND @ 

Formulas (17), (18), (19) and (20) in a note by the author “Some 
recurrence formulas in the incomplete beta function ratio,” Annals of 
Mathematical Statistics, Vol. XX (1949), provide a means of obtaining 
values of p and q not included in Pearson’s Tables. 


7. WORKED EXAMPLE—1-TEST 


Snedecor, Statistical Methods, 4th edition, page 82, Example 4.13, 
gives t= 1.669 with degrees of freedom, n, equal 23. Then, from the In- 
troduction to Pearson’s Tables, P(|t| 2to) =I2,(n/2, 1/2), where 


to? —1 
Xo = (1 + ~) = .8920. 
n 


Hence, P(|t| 21.669) =TZ .s920(11.5, .5). 
Using (19) referred to in Section (2), i.e. 





ae | 
[.(10.5 +n, q) = 9.5 ()7,(10.5, 
7,(10.5 + n, 9) 0542)” | ¢ + q + n)I,(10.5, 9) 


- (*)a@s +4 +n)°-01,(10.5, ¢ + 1) + 
(—1)"(q + n — 1)7,(10.5, ¢ + n)| 
we obtain 
1 
I .9920(11.5, .5) = = [117 s020(10.5, .5) — .57.920(10.5, 1.5) J. 


Using 4-point interpolation to obtain J,, values, as referred to in Sec- 
tion 1, 
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1 
T .9920(11.5, .5) = — [11(.1374165) — .5(.5193045) | 


= .1192. 


Hence, P(|t| >1.669) =.1192. Inverse linear interpolation, using the 
Fisher and Yates Table III, gives P=.12. 


8. WORKED EXAMPLE—F-TEST 


Snedecor, Statistical Methods, 4th edition, page 239 gives Fo =1.934 
with n,=6, n.=108 as the respective degrees of freedom. Then, from 
Introduction to Pearson’s Tables, P(F2Fo)=1—TI.,(p,q), where 
Lo =F o/(ne+mFo) =.0970, p=n/2=3, g=n2/2=54. Then using 
I.(p, q) =l1- I,_.(q, P); P(F2 Fo) =T 9930(54, 3). 

Using (17) referred to in Section (2), i.e. 


I,(50 + n, q) = (n + q + 49)T7,(50, q) 


1 
wraal 

n 

1 


<< ( )atn + q a 49) ("D7 ,(50, q +. 1) oa 


(—1)*(q + n — 1)1,(50, 9 + n)| 


we obtain 





T 9030(54, 3) = [(56) T 9030(50, 3) — 4(56) @(3)I.9030(50, 4) 


(53) 
+ 6(56) (4) J 9930(50, 5) — 4(56)(5) TZ .9030(50, 6) 
+ 6T 9030(50, 7) J. 


Using 4-point interpolation to obtain J,, values as referred to in 
Section 2: 


T .9020(50, 3) = .1086 T .9030(50, 6) 
T 9030(50, 4) = .2314 T .9030(50, 7) 
T 9030(50, 5) = .3892. 


5545 
7015 


Substituting above, 











1950 


34 
om 
are 
ng 
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1 
9030(54, 3) = 56) (55) (54) (53) (.1086 
T .9030( ) (53) (52) (51) (50) [(56) (55) (54) (53) ( ) 
— 4(3)(56) (55) (54) (.2314) + 6(56) (55) (4) (3) (.8892) 
— 4(56)(5)(4)(3)(.5545) + (6)(5)(4)(3)(.7015) ] 
I 9030(54, 3) os .0818. 


Hence, P(F 2 1.934) = .0818. Inverse linear interpolation in the Mer- 
rington and Thompson Tables gives P= .086. 





9. LIMITATIONS OF METHODS OF SECTION 7 AND 8 ABOVE 


The computational labor restricts the values that may be obtained 
beyond the range of the tables. Also rounding reduces the accuracy 
from 7 decimals of the table to about 4 for 10 units in p and g beyond 
the end of the table range. 





ON THE MEASUREMENT OF THE 
PRODUCTIVITY OF LABOR 


S1emunp P. ZosBEeu 
The University of Buffalo 


This paper considers problems to be overcome in the meas- 
urement of the productivity of labor. A listing of pertinent 
factors affecting the productivity appears, and indexes which 
adjust for some of them are presented. 


EASURES OF productivity of jabor are important analytical tools. 

In fact, it has been said, “Tre history of the productivity of our 
labor is the foundation of a scientific economic history, and the back- 
bone of any and all history.” 

Methods which are functions of physical output and of labor input 
[r=f(P, L), where r=productivity of labor, P=production, and L= 
labor utilized], as determined by man-hours, man-days, etc., or approxi- 
mations thereto, have been in use for many years, and are familiar to 
the statistician and economist. However, much ado has been made con- 
cerning the inadequacy of existing measures of productivity of labor. 
It is the purpose of this paper to present revisions which are intended 
to remove a few of the objections to currently used basic forms of 
measurement. 

First, consider the usual productivity measure, in which the ratio 
of total output to total man-hours consumed in the production of that 
output is obtained, resulting in output per man-hour. This result is 
termed “the productivity of labor.” But, is it? Regarded superficially, 
it may be considered as such. However, the strong implication is made, 
by the very use of this ratio, that the output is wholly, or largely, the 
result of labor’s efforts alone. Yet, this is not the case. Productivity of 
labor cannot be regarded as being other than a multivariate function. 
An indefinite number of factors may affect the individual employee’s 
ability to do his job—anything from his breakfast toast being burned to 
balmy weather outdoors which makes him think more of fishing than 
working. 

In view of the multiplicity of pertinent variables, we may now reject 
the earlier definition of productivity of labor, r=f(P, L), and turn to 
one which more adequately represents the true situation, such as r= 
f(%1, Xe, 3, . .. Xn), Where 7 represents the productivity of labor, and 





1 Simkhovitch, V. G., ‘‘Rome’s Fall Reconsidered,” Political Science Quarterly, 31 (June, 1916), p. 
243. 
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each x is a factor affecting the productivity, one of which is the effort of 
labor itself. 

As an aid to investigating the nature of this function, let us note some 
of the variables which are present. These variables are factors which 
bear on the final productivity of labor. For purposes of classification, 
they may be considered as objective, originating primarily in physical 
conditions of work, and as subjective, stemming mostly from an indi- 
vidual’s policies, attitudes, etc. They may be listed as follows: 


Objective factors: 


I. Related to plant and equipment 
1. Production methods 
2. Age or obsolescence 
3. Degree to which plant capacity is utilized 
4. Use of marginal plants 
5. Mechanical power consumed 
. Related to the flow of goods (input, process, output) 
. Supply arrangements 
. Quality control methods 
. Relative quality of various products 
. Importance of products 
. Prices of various factors 
. Output 
. Others 
1. Geographical location 
2. Phase of the business cycle 


Subjective factors: 


I. Administrative 
1. Management element 
2. Relationship of hours of work to optimal hours of work 
II. Individual 
. Worker element 
. Shifts in employment 
. Training 
. Type of work 
. Length of work week 
. Level of wages 
. Labor organization 
. Specialization 





220 AMERICAN STATISTICAL ASSOCIATION JOURNAL, JUNE 195 


We have, then, this large group of factors which affects the level of 
productivity. Their multiplicity requires some form of multivariate 
analysis, and the technique which suggests itself is that of multiple cor- 
relation. If the function could be put into the form of the multiple re- 
gression equation, 


Li = a + bore + bars + data + Dsr5---, 


where z,= productivity, and 2, x3, etc., are the various factors deter- 
mining productivity, the net regression coefficient accompanying the 
variable indicative of labor’s efforts would be a criterion of how produc- 
tivity is influenced by labor’s efforts alone. And, ratios between the co- 
efficients obtained at different times would constitute a significant 
index of changes in productivity of labor. 

Although the solution seems to be at hand, it is not feasible inasmuch 
as most of the variables cannot be expressed quantitatively, and if the 
analysis were made with only those factors present which could be eval- 
uated, the error component would be so large as to render the results 
untenable. Hence, for the present, this solution is not practicable. It is 
to be hoped that further research, and developments in the quantita- 
tive evaluation of many of the factors cited above, will enable applica- 
tion of multiple correlation analysis to the problem at hand. Until 
then, the best that can be done is to seek an improvement in the exist- 
ing measures, or to obtain a more judicious interpretation of the existing 
data. At least two noteworthy efforts toward these ends have been 
made. 

One of these was made by G. T. Jones, who realized the shortcomings 
of the usual forms for measuring the productivity of labor, and decided 
upon a device which allowed for at least one of the other factors affect- 
ing productivity. His series of productivity of labor is the reciprocal of 
the labor cost at a fixed year wage rate per unit product. This was ar- 
rived at since he concluded, “It appears that changes in the effectiveness 
of labour are measured more accurately by the reciprocals of the index 
numbers of labour costs at base wage rates per unit product than by 
figures showing output per man-hour irrespective of changes in the 
composition of the labour force or the length of the working day. More- 
over, the reciprocals of the index numbers of real cost measure changes 
in the efficiency of an industry better than any device which neglects 
the fact the machines which make economies in labour costs possible 
are themselves costly.”? 





* Jones, G. T., Increasing Return (edited by Colin Clark, Cambridge, University Press, 1933), p. 50. 
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Other than by the verbalization of the method, the suggested form is 
not indicated by Mr. Jones. But with this as a starting point, three 
forms can be devised. The definition suggests 

1 
I,=— 
le 
where J, is the index of productivity, and J,,=index of labor cost at 
base wage rates per unit product. Hence, the form of the productivity 
index depends upon the form of the labor cost index. One unweighted 
and two weighted methods may be formulated. 


Let Ic;;=cost per unit of output of each type of labor in period 7 
lcjo=cost per unit of each type of labor in the base period o 
w;=a standard ratio of time required per unit of output by la- 

bor type j to total time required per unit by all types of 
labor 
n=number of different kinds of labor required 
k=number of products. 
For the indexes, we may use 


> > Lei jm 


m=l j=l 





Tie; = 


p >» Icojm 


m=] j=l 


which is an unweighted relative of aggregates unit of labor costs index; 


k n 


De Ly eijmtjm 


m=] j=l 


b) Ii; = 





k n 


Do De lojm tO jm 


m=l j=l 
which is a relative of weighted aggregate unit labor costs index; or 
k n 
) »  » Wim 
m=1 j=l leojm 
k 


} es Wim 


m=1 j=l 





The; = 


which is a weighted arithmetic mean of labor cost relatives. 
The reciprocals of these yield the indexes of productivity. Thus, as 
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additional, and, perhaps, more reliable measures of productivity, the 
investigator may use one of the following three: 


k n 


> , » a 


mal jul 


(1) Tp; 





k n 


= i Lc; jm 


m=] j=l 


k n 


y 7. le, jmW jm 


mal j=l 


k n 


Zz: > LCi jmW jm 


m=] j=l 





k n 


» Dd Wim 


m=1 j=l 


(3) I, 





" k n ae 
) ip om Wjm 
m=1 j=l leo jm 

The first form, being unweighted, is the quickest and easiest one to 
use, of course. If the various operations per unit all have approximately 
the same individual costs, then this method will give as reliable results 
as any other. Formula (2) differs only in the use of weights, and serves 
the same purpose. As any properly weighted index, it should be more 
reliable and less biased than the unweighted form. The third form, rec- 
ognizable as a weighted harmonic mean of labor cost relatives recipro- 
cals, is the most laborious to compute, but when the labor costs are at 
substantially different levels, it will give the most unbiased results. 

From all of these, it can be seen that productivity is defined as a 
function of the labor costs. This is certainly a tenable approach, since 
it is the equivalent of saying that changes in the productivity of labor 
are noticeable by changes in the cost of labor, with the assumption be- 
ing made that the more productive labor is, the cheaper should be its 
cost per unit. 

Another effort to account for the effects of other factors upon changes 
in productivity is the suggestion, made by WPA statisticians in 1939,* 
that indexes of productivity be calculated by means of both the base 
period composite of products and the current year composite. Differ- 





3 Works Progress Administration. Production, Employment and Productivity in 59 Manufacturing 
Industries, Report No. 8-1 (Philadelphia, May, 1939). 
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ences in the results will then reflect the joint changes in unit labor re- 
quirements (or production per man-hour) and the output of various 
products, which it will be remembered, is one of the factors cited ear- 
lier. The difference will be pronounced when there is a distinct correla- 
tion in the relative changes of production and productivity of the 
individual products. Thus, if productivity increases more rapidly for 
those products showing more rapid rises in production, the productivity 
index for the changing composite will be higher than the index for the 
base year composite. 

The foregoing suggests a form of bias which can be minimized by us- 
ing a geometric mean of the two measures for the same period of time, 
one being the fixed composite and the other being the changing com- 
posite : 





Do eho Dy TeiMh; 


kel k=l 





p WkoQko > Woh; 


k=l k=1 


deo = Quantity manufactured in period o of product k 
Qxi = Quantity manufactured in period 7 of product k 
Tko= Output per man-hour in period o for product k 
w.;= Output per man-hour in period 7 for product k 
n=number of different products in composite. 


If all of the required data are available, Formula (4) yields an index 
recognizable as a form of Fisher’s Ideal Index. Those who accept Mr. 
Fisher’s tenets will accept this as a less biased measure than most of 
those currently in use. 

Mechanical power consumed was another factor mentioned earlier 
as affecting productivity. The nature of the relationship is inverse, 
such that the more power is consumed, the less a given output is due to 
the efforts of labor alone. This suggests another form of measurement 
which, by adjusting for changes in power consumed, results in a meas- 
ure of productivity of labor free from at least that one extraneous fac- 
tor. By applying such an adjustment to Formulae (2) and (3), I believe 
that a considerably less biased measure is thereby obtained. 

Let E; be an index of power consumed, on the same base as the 
productivity index. Then, (2) becomes 
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(5) I,, = 


and (3) becomes 


(6) I,, = 
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These two measures make allowances for both changes in the aid given 
the labor force by machines, and changes in the time or effort expended 


by the employees. 


Formulae (5) and (6) therefore make allowance for more of the fac- 
tors affecting productivity of labor than do any of the other measures 
presently in use. Because of this, the writer is of the opinion that greater 
reliability can be attached to these two as measures of the productivity 
of labor than most other productivity measures which have been em- 


ployed. 





LARGE SAMPLE TESTS AND CONFIDENCE INTERVALS 
FOR MORTALITY RATES 


JoHN E. WALSH 
The RAND Corporation 


In computing mortality rates from insurance data, the unit 
of measurement used is frequently based on number of policies 
or amount of insurance rather than on lives. Then the death 
of one person may result in several units of “death” with re- 
spect to the investigation; moreover, the number of units per 
individual may vary noticeably. Thus the usual large sample 
methods of obtaining significance tests and confidence inter- 
vals for the true value of the mortality rate are not applicable 
to these situations. If the number of units associated with each 
person in the investigation were known, accurate large sample 
results could be obtained; however, determination of the num- 
ber of units associated with each individual would require 
an extremely large amount of work. This article presents some 
valid large sample tests and confidence intervals for the mor- 
tality rate which do not require much work and are reasonably 
efficient. More general situations are also considered. 


INTRODUCTION 
ET Us consider a large number n of sample values from a binomial 


population for which g is the probability of a failure. If qg’ is the 
fraction of failures in this sample, asymptotically (n— ©) the distribu- 
tion of 





(q’ — g)Vn/q'(1 — 9’) 


is normal with zero mean and unit variance. This quantity can be used 
to obtain large sample confidence intervals and significance tests for gq. 
In particular, these results can be used to obtain large sample tests and 
confidence intervals for the rate of mortality when the investigation is 
based on lives. Then n represents the number of individuals under ob- 
servation, g is the probability that an individual dies within the interval 
of time considered (i.e., the rate of mortality for this interval), and q’ 
equals the number of deaths during the interval divided by n. Here the 
rate of mortality gq can also be interpreted as the expected value of the 
fraction of deaths among the people under observation during the speci- 
fied time interval. 

Now let us consider situations where the rate of mortality investi- 
gated is one of 

(a) The expected value of the fraction of the total number of policies 
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AMERICAN STATISTICAL ASSOCIATION JOURNAL, JUNE 1959 


under investigation which are paid within the interval of time 
considered. 

(b) The expected value of the fraction of the total amount of in- 
surance in force which is paid during the specified interval of 
time. 

In case (a) each insurance policy is a unit of the investigation while in 
case (b) the unit is some specified amount of insurance (e.g., $100 
worth). For both cases let n be the number of individuals under obser- 
vation, m; the number of units associated with the 7” person 
(i=1, - - -,n;)>>m;=m). Then, if q is the probability of a person dying 
within the specified interval of time, for both (a) and (b) the rate of 
mortality is given by 


(qm, +--+ + Qm,)/m = q >, mi/m = Q. 


Thus the rates of mortality based on lives, policies, and amounts are 
the same for this situation. In cases (a) and (b), the usual estimate for 
the corresponding mortality rate is the number of units paid during 
the specified time interval divided by m; let us denote this estimate 
by q’’. The expected value of q’’ is q while its variance equals 
q(1—q)>.m2/m?. Then, if max m; does not become indefinitely large as 
m— ©, it follows from the Central Limit Theorem and the convergence 


theorem [1] that asymptotically (m— ©) the distribution of 
(1) m(q’’ — g)/Vq""(1 — @") Do m? 


is normal with zero mean and unit variance. Thus, if the m, are known, 
valid large sample tests and confidence intervals can be obtained for q 
when the investigation is based on policies or amounts. However, the 
amount of work required to determine the m; is usually so prohibitive 
that use of (1) is out of the question. 

To obtain an accurate expression for the variance of q’’ it is neces- 
sary to have knowledge of the values of the m;. Attempts have been 
made to estimate this variance without such knowledge but the result- 
ing expressions are at best extremely rough approximations and usually 
appreciably underestimate the true value. For example, in investiga- 
tions based on policies it is sometimes assumed that the variance of q’’ 
is approximately equal to g’’(1—q’’)/m. Then 








(q’’ — gv m/q'"(1 — q”’) 


is used under the assumption that its asymptotic distribution is normal 
with zero mean and unit variance. This can lead to absurd results. As 
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an example, let the average number of policies associated with each 
person be at least two. Then the variance of this quantity is not unity 
but is two or greater. 

The purpose of this paper is to present some accurate large sample 
tests and confidence intervals for the rate of mortality which are readily 
computed for the usual type of insurance data. These results do not 
furnish as much “information” as the tests and intervals based on (1) 
but ordinarily this loss of efficiency is greatly outweighed by the com- 
putational savings. Compared to the results based on (1), the power 
efficiencies of the tests presented are in the neighborhood of 70 per cent. 
This means that the “information” obtained by applying these tests to 
all the observations is approximately the same as the “information” 
obtained by applying the corresponding tests based on (1) to only 70 
per cent as many observations. Since the amount of data is huge for 
most insurance investigations, however, this “loss” of 30 per cent of the 
observations is usually not of great importance. An intuitive explana- 
tion of the meaning of power efficiency is given in [2]. 

For many insurance investigations, the probability of death within 
the specified time interval is not the same for all the individuals under 
observation. Instead, several different classes of risks are combined and 
it is desired to find the rate of mortality for the combined group. Then 
use of (1) is no longer appropriate. However, if certain uniformity con- 
ditions hold with respect to the alphabetical distribution (last name) of 
the members of the different classes of risks and with respect to the 
distribution of the units among the individuals, the tests and intervals 
presented in this article are still applicable. It seems likely that these 
uniformity conditions will be approximately satisfied for the usual type 
of situation if the number of individuals in each class of risks is very 
large while the maximum number of units per individual is very small 
compared to the total number of units under investigation. 

An extension of these results to more general types of situations is 
presented in the Appendix. 


OUTLINE OF METHOD 


First let us consider the case where the probability of death within 
the specified time interval is the same for each person of the investiga- 
tion; also these individuals represent statistically independent observa- 
tions. The problem is to obtain easily applied tests and confidence 
intervals for the common probability of death (i.e., rate of mortality) 
when the investigation is based on policies or amounts. 

As the first step of the method, let the total number of units be di- 
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vided into 26 subgroups on the basis of the first letter of the last name 
of the people insured. Since it is not a common occurrence for the same 
person to have insurance under last names beginning with different 
letters of the alphabet, these subgroups can be considered as approxi- 
mately statistically independent. Next, in some previously specified 
manner, combine some of these subgroups until 10-15 subgroups con- 
taining approximately the same number of units are obtained. These 
subgroups are also statistically independent. For each of these sub- 
groups compute the fraction consisting of the number of units paid 
during the specified time interval divided by the number of units in the 
subgroup. Let q:’’, - - - , g-’’ denote the resulting statistics. Then, using 
the same argument as for (1), asymptotically (m— ©) these fractions 
represent a set of r independent observations from normal populations 
with common mean equal to qg. Thus, if the number of units investi- 
gated is very large, it is approximately true that q,’’, - - - , g-’’ is a set 
of independent observations from continuous symmetrical populations 
with common median equal to the rate of mortality. Consequently the 
results of [3] and [4] are directly applicable for finding confidence inter- 
vals and significance tests for g on the basis of q:’’, - - +, qr’’. 

Table 1 contains a list of some one-sided and symmetrical signifi- 
cance tests for comparing g with a given hypothetical value go for 
1057515 (x, - - - , x represent the values of q:’’, - - - , g,’’ arranged in 
increasing order of magnitude). Additional tests can be obtained from 
[3, Table 1] and by use of the theory developed in [4]. The correspond- 
ing confidence intervals and confidence coefficients can be obtained 
from these tests in the usual manner. The point to be remembered in 
converting from these tests to the corresponding confidence intervals 
is that the significance level of a test equals the probability of the rela- 
tion defined by the test holding when ga=q. For the tests considered 
here this automatically gives the probability that a certain interval does 
not include the true value of g, whence the confidence coefficient of that 
interval is determined. As an example, let us consider the case where 
r=14, Then the one-sided test 


Accept q < qo if max [x10 $(%s + 24) | < qo, 


with 1 per cent significance level yields the one-sided confidence inter- 
val 


(— ©, max [10, 4(26 + 2) }) 


with 99 per cent confidence coefficient; i.e., the probability that the 
relation 
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— © <q < max [z10, #(z6 + tu) ] 


holds equals 99 per cent. Similarly the corresponding symmetrical test 
yields the confidence interval 


(min [xs, 3(t1 + 2)], max [210, $(26 + 2x) }) 


with 98 per cent confidence coefficient. 

One application of confidence intervals for the rate of mortality oc- 
curs when graphical interpolation is used in the construction of a mor- 
tality table. Here the true value of the rate of mortality varies with age. 
For each age it is useful to have confidence intervals for the correspond- 
ing rate of mortality. The confidence intervals employed are usually 
symmetrical and have confidence coefficients which vary from 50 per 
cent to around 90 per cent. The procedure used in graphical graduation 
is to choose one or more confidence coefficient values and then obtain 
confidence intervals with these confidence coefficients for each age (one 
confidence interval for each confidence coefficient). These confidence 
intervals are then plotted on an age versus mortality rate graph (along 
with the mortality rate estimates). The person performing the graphi- 
cal graduation is guided by these confidence intervals when drawing 
the curve which is to represent the graduated mortality rates. He at- 
tempts to draw this curve so that for each set of confidence intervals 
with a common coefficient the percentage of ages where the curve lies 
within the confidence intervals is approximately equal to the value of 
the confidence coefficient. For example, consider the case where the 
confidence coefficient values chosen are 60 and 80 per cent. Then for 
each age there is a confidence interval with coefficient 60 per cent and a 
confidence interval with coefficient 80 per cent. The graduator would 
attempt to draw the curve so that it lies within the confidence intervals 
with coefficient 60 per cent for about 60 per cent of the ages and within 
the confidence intervals with coefficient 80 per cent for about 80 per 
cent of the ages. 

Easily computed symmetrical confidence intervals for the rate of 
mortality with confidence coefficients in the range 50-90 per cent can 
be obtained by applying the results of [4] to q:’’, ---, q-’’. Table 2 
contains a list of some symmetrical confidence intervals for 10Sr315. 
By applying the method outlined at the beginning of this section sepa- 
rately to each age, sets of confidence intervals suitable for use with 
respect to graphical graduation are readily obtained. 

Now let us consider the case where the probability of death within 
the specified time interval is not the same for each person of the in- 
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vestigation. Then the method of obtaining large sample tests and con- 
fidence intervals for the rate of mortality based on (1) is not necessarily 
applicable. The method presented in this section is valid, however, if 
the alphabetical distribution of the units and of the different types of 
risks is such that q:’’, - - -, g-’’ have the same expected value. This 
result is a consequence of the material presented in the Appendix. If 


TABLE 2 
SOME SYMMETRICAL CONFIDENCE INTERVALS FOR 10<rs15 








Confidence Interval 


Confidence 
Coefficient Lower Endpoint 





Upper Endpoint 





50% 


4 (211 +29) 


4 (22 +210) 





75% 


4 (21 +25) 


4 (23 +210) 





50% 


4 (zt +210) 


4 (t2 +21) 





75% 


4 (21 +25) 


4 (ts +211) 





50% 


$ (411 +21) 


4 (22 +212) 





75% 


4 (21 +210) 


4 (23 +212) 





50% 


4 (21 +212) 


4 (x2 +213) 





75% 


4 (a1 +21) 


4 (%3 +213) 





50% 


4 (21 +213) 


4 (t2 +21) 





75% 


] (x1 +212) 


§ (a3 +2) 





50% 


$ (a1 +21) 


4 (22+215) 





75% 








4 (21 +213) 





4 (23 +215) 





the maximum number of units per individual is very small compared 
to the total number of units in the investigation and the variation in 
the probability of death is not great for the individuals considered, it 
appears likely that this relation will be approximately satisfied for the 
usual type of investigation involving an extremely large number of 
units. This contention is based on the intuitive observation that on the 
average the probability of death does not depend on the first letter of 
the last name of the person considered. 
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The essential property of the method outlined is the division of the 
observations into statistically independent subgroups such that the ex- 
pected values of the observed mortality rates for these subgroups have 
a common value. Any method which has this property and satisfies the 
asymptotic normality requirement is eligible for use. The alphabetical 
method presented was chosen because it appeared to have computa- 
tional advantages. 


EFFICIENCY INVESTIGATION 


The tests and confidence intervals presented in the preceding section 
are recommended by their ease of computation and generality of appli- 
cation. These favorable points would be of little value, however, if 
these tests and confidence intervals should happen to be extremely in- 
efficient. The purpose of this section is to find power efficiencies for the 
tests of Table 1 for the special case where each of the r subgroups con- 
tains the same number of units and q,’’, - - - , g-’’ have the same vari- 
ance as well as the same expected value. Here it is not assumed that the 
probability of death is the same for each person of the investigation. 

Let q be the true value of the rate of mortality (i.e., the expected 
fraction of the total number of units under investigation which are 
paid during the specified time interval) and o? the common variance of 
qi’’, - - +, q,’”. Under very general conditions (see Appendix), asymptot- 
ically q:’’, - - -, g-’’ represent the values of a random sample from a 
normal population with mean q and variance o*. Also for a rather wide 
class of situations )-q;’’/r is an efficient estimate of q (see [5] for 
definition of efficient estimate). The class of situations where these 
normality and efficiency conditions are approximately satisfied would 
seem to include most insurance investigations based on a large number 
of units. For example, these conditions hold if the total group of indi- 
viduals can be subdivided into a finite and fixed number of classes such 
that the probability of death is the same within classes (but different 
for different classes) while asymptotically the number of units in each 
class becomes indefinitely large and the maximum number of units per 
person is bounded. This result follows from the application of maximum 
likelihood theory to this situation. In the remainder of this section it 
will be assumed that asymptotically q:’’, - - - , g-’’ are a sample from a 
normal population and that >-q;’’/r is an efficient estimate of q. 

For the situations considered, the asymptotic distribution of the 
quantity 


(2) vi(— Da” -a)/ ; 
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is normal with zero mean and unit variance. If o* could be assumed 
known, the most powerful one-sided and symmetrical tests for compar- 
ing q with a given value qo formed on the basis of (2) would be at least 
as powerful as the corresponding most powerful tests for the case where 
ois unknown. This follows from the fact that >°q.’’/r is an efficient 
estimate of g. Thus the power efficiencies computed using (2) to furnish 
the most powerful tests (o? known) will be less than or equal to the 
power efficiencies based on the most powerful tests for o? unknown; i.e., 
conservative values will be obtained for the power efficiencies. In the 
following analysis the most powerful tests used as a basis for finding 
power efficiencies will be those obtained by using (2) under the assump- 
tion of known o?. 

The method of defining power efficiency given in [4] and intuitively 
explained in [2] will be used here. Essentially this amounts to adjusting 
the sample size for the corresponding most powerful test (same signifi- 
cance level) until its power function is approximately equal to the 
power function for the given test. The resulting sample size for the most 
powerful test divided by the sample size for the given test is called the 
power efficiency of the given test. As pointed out in [4], for the tests of 
Table 1 it is sufficient to investigate one-sided tests of g<qo. The power 
efficiency of the corresponding one-sided test of g>qo (same significance 
level) has the same value as the power efficiency of the given test of 
q<4qo; also the symmetrical test of g#qo based on these two one-sided 
tests has the same power efficiency as the one-sided tests. 

The power function of the most powerful test of g<gqo based on s 
sample values y:1,---, ye from a normal population with unknown 
mean g and known variance o? equals 


Pr [V/s(5 — qo)/0 < — Ka] 
Pr [V/8(5 — g)/o < — Ka + V8(qo — 9)/c] 
= f —Kytva6 elder, 


where a is the significance level of the test, 5=(go—q)/c, and Kaz is 
defined by the relation 


(3) 


=f. edz = a 
Vind x, : 


For the situations considered, this expresses the power function of the 
most powerful test of ¢<qo at significance level a as a function of the 
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TABLE 3 
POWER FUNCTION VALUES FOR THE TESTS OF TABLE 1 








Signifi- Values of Power Function 
re cance 
bize | Level | 5=.4/ 5=.6| 5=.8 


Sample 





Significance Test 





(2) j .0557 | .304 715 
max [ze, $ (24+210) } <qo .0557 | .312 712 





(2) j .0254 | .189 .576 
max [x7, $ (%s+210) ]<Qo .0254 | .194 .577 





(2) : .0107 
max [zs, $ (z6+210) | <@o .0107 





(2) Bi .0049 
max [xo, 4 (xe+210) | <qo .0049 





(2) , .0278 
max [x:, 3 (25+211) |] <qo .0278 





(2) ; 0054 
max [x9, $ (a7 +211) [ <Qo .0054 





; (2) . .0102 
max [z9, 4 (z6+212) [| <qo .0102 





(2) ; .0051 
max [z10, $ (z7 +213) ] <qo .0051 





(2) ‘ .0100 
max [x10, § (ze +214) [<qo .0100 





(2) .0050 
max [zu, 4 (x1 +215) ] <q, .0050 


























parameter 6. Thus, given a one-sided test of g<qpo at significance level a 
from Table 1, the problem is to determine the value of s so that the 
power function (3) is approximately the same as the power function of 
the given test (both power functions expressed as functions of the 
parameter 6). Division of the resulting value of s by the value of r 
yields the power efficiency of the Table 1 test considered. Here s is 
allowed to assume non-integral values (see [2] for interpretation of non- 
integral sample sizes). 

Table 3 contains a list of power function values for the tests of 
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Table 1. These power function values were taken from [4] and [6]. The 
power function values for the corresponding tests based on (2) were 
obtained by use of (3) for fractional values of s. The values of s given 
in Table 3 were used to compute the approximate power efficiencies 
listed in Table 1. 

Although only a special case was considered, the power efficiency 
investigation of this section would seem to indicate that the tests pre- 
sented in this paper are sufficiently efficient to be of practical value. 
No confidence interval efficiency investigations will be made. However, 
the close relationship between a confidence interval and a test based on 
this interval indicates that the confidence intervals considered in this 
paper will have reasonably high efficiencies. 


PRACTICAL APPLICATION 


Now let us consider a procedure for applying the method of this 
paper to an actual insurance investigation. Here the problem is to com- 
pute the values of the g:’’, - - - , g-’’ in such a manner that the usual 
point estimate for the rate of mortality is obtained in the same opera- 
tion. (The value of this point estimate equals the total number of units 
paid divided by the total number of units exposed to risk.) 

In addition to the usual information listed for the investigation, the 
first letter of the last name of the person insured must be recorded for 
each policy. Then the totality of units is divided into r subgroups on the 
alphabetical basis previously mentioned. Separately, for each of these r 
subgroups, the units exposed to risk and the “deaths” (i.e., units paid) 
are obtained in the usual manner (see, e.g., [7]). The ratio of “deaths” to 
exposed to risk for each subgroup yields the values of q:’’, - - - , g-’’. To 
obtain the usual point estimate for the mortality rate, the totality of 
“deaths” for all subgroups is divided by the sum of the exposed to risk 
for all subgroups. 

The method proposed differs from the ordinary method of obtaining 
the point estimate for the rate of mortality in two respects. First, there 
is the additional step of recording the first letter of the last name of 
each person of the investigation. Second, the exposed to risk and 
“deaths” are obtained separately for subgroups rather than for the 
combined data. If the procedure of recording the first letter of the last 
name is instituted at the initial stage of the investigation, it would seem 
that little extra effort is required for this recording. If the investigation 
is large and punched card equipment is used, sorting the units into the 
required subgroups and computing the exposed to risk and “deaths” 
separately for each subgroup would not appear to necessitate sub- 
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stantially more work than is required to obtain the point estimate. 
Thus the method of this paper is easily applied from a computational 
viewpoint if the alphabetical information is recorded when the other 
information for the investigation is obtained. 

According to present practice, however, no alphabetical information 
is recorded for mortality investigations. Thus obtaining this extra data 
for studies already begun would require much additional work. For 
studies not yet begun, however, recording the alphabetical information 
would require little additional effort. 

With respect to computation of the exposed to risk and the “deaths,” 
the formulas used are applied to situations where some of the people 
are only exposed for a fraction of the specified time interval. This 
would not appear to invalidate the considerations of the previous sec- 
tions. Similarly for the approximations used in computing the number 
of units exposed to risk. 


APPENDIX 


The tests and confidence intervals for the rate of mortality presented 
in this paper are special examples of some general asymptotic results. 
This section contains an outline of these asymptotic results. 

Let > -%n; independent observations be drawn from populations 


satisfying the conditions 

(i) The first three moments of each population are finite. 

(ii) There exist two fixed positive numbers such that the value of the 

variance of each population lies between these numbers. 

It is to be emphasized that no two observations are necessarily drawn 
from the same population and that no population is necessarily con- 
tinuous. These > in, observations are drawn as k sets of m, +--+, m% 
observations, respectively. Form the means fi, - - - , # of these k sets. 
Let E(%;) =ui(ni), (@=1, - - - , &), and consider 


[51 — wil) | m, -- +, [Ge — wale) |r. 


Let min; n;—0. Then, by the Central Limit Theorem, in the limit k 
independent observations are obtained which are from continuous 
symmetrical populations with zero medians (in fact, asymptotically 
each observation has a norma! distribution with zero mean but un- 
known finite non-zero variance). 

The above asymptotic result shows that j:, - - - , J are independent 
observations from populations which are very nearly continuous and 
symmetrical with medians y:(m), - - - , ux(mxz), respectively, if min 7; is 
sufficiently large. Thus, if min n; is large and wi(m)= - - - =px(nx) 
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=p(m1, +--+, Nx), it is frequently permissible to obtain test and confi- 
dence intervals for u(m, - - - , nx) by applying the results of [3] and [4] 
to fi, - ++) Hee 

It is to be noted that conditions (i) and (ii) are not very restrictive 
from a practical viewpoint. Nearly all populations approximated in 
practice satisfy condition (i). Also, populations with arbitrarily small 
(near zero) or large variances are seldom, if ever, approximated in 
practical situations. 
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STATISTICAL DECISIONS BY THE METHOD OF 
MINIMUM RISK: AN APPLICATION 


R. Cuay Sprow.is 
The University of Chicago 
A. Wald’s method of minimum risk is illustrated by a simple 
rule for deciding whether to adopt any recommended system 
for betting on race horses. A detailed example is given. Ex- 
tensions to more realistic problems about horse betting and to 


more dignified risk opportunities such as quality control are 
suggested. 


1. INTRODUCTION AND STATEMENT OF THE PROBLEM 


BRAHAM WALD has presented in a sequence of papers, a new meth- 
ny od of statistical inference called by him the method of minimum 
risk.' This method promises to be of value especially in situations where 
decisions are made in the presence of uncertainty and where the outcome 
of these decisions can be measured objectively. This paper presents a 
self-contained and reasonably detailed example of the method of mini- 
mum risk as applied to a simple, if somewhat artificial, gambling situa- 
tion. The author hopes the example, which relates to betting on horse 
races, will be found interesting for its own sake, few such examples 
having been worked out, and that the presentation will help stimulate 
interest in Wald’s theory among applied statisticians. 

While wagering on race horses is less important than other economic 
phenomena which involve making decisions in the face of risks, its use 
as an illustration of Wald’s method is justified by the simplicity of the 
gambling situation and the disclosure of the striking influence which 
risk has on the bettor’s decision. 

The problem may be stated as follows: a bettor is interested in bet- 
ting on a horse race. He bets a fixed amount; if he wins, he knows the 
amount of his winnings. He has a system, i.e., some objective scheme, 
which selects for him the one horse in any race on which he will bet if 
he chooses to bet at all. Two courses of action are open to him: to bet 
or not to bet. For the purposes of this paper only two possible outcomes 
of a race are considered. Either a horse runs first (“wins”) or it loses. 





1A. Wald, “Contributions to the Theory of Statistical Estimation and Testing Hypotheses,” 
Annals of Mathematical Statistics, X (1939), 299-326. See also A. Wald, “Sequential Decision Functions,” 
Econometrica, XV (1947), 279-313, for a more complete bibliography. The reader may want to establish 
the relation between the problem presented here and the theory of games. See J. von Neumann, “Zur 
Theorie der Gesellschaftsspiele,” Mathematische Annalen, C (1928), 295-320. Also J. von Neumann and 
Oskar Morgenstern, “Theory of Games and Economic Behavior,” Princeton University Press, 2nd edi- 
tion (1947). 
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The bettor has observed the performance of his system in a sequence 
of n races, and must now decide what action to take on the next race. 
Neither the operation of the system nor the information (observations) 
costs anything. The problem is to formulate a “wise” rule for deciding 
whether to bet or not to bet. 


2. THE METHOD 


If the bettor pursues a policy of betting on every race, his expected 
income from any one bet will be Y=ap—fq, where: 

1. Y is the net expected income above the amount wagered. 

2. a is the net amount won on any one race which he wins. It is 
assumed constant. 

3. B is the amount lost on any one race which the bettor loses. It is 
also assumed constant. The bettor risks the same amount on every 
race. 

4. p is the unknown probability of the system picking a winner, 
0Spsl. 

5. q=1—p. 

The expected income Y is shown graphically in Figure 1 as a function 
of p. 

The expected income function for a policy of never betting will be 
Y=0. That is to say, “nothing ventured, nothing gained.” 

The bettor learns from Figure 1 that there is a value of p, call it po, 
for which the net income is zero when every race is bet. If p is less than 
po, losses are incurred; if p is greater than po, gains are earned. He thus 
has good reason for wanting to bet only if p is greater than po. Since p is 
assumed to be unknown, the bettor will want to utilize information 
about p that is available, namely, the outcomes of the preceding n races. 

If a one is scored for a win and a zero for a loss, a sequence of out- 
comes (x;) of n races may be represented thus: 

000101100100001101 - - - x; - - - 2,. The number of wins in this se- 
quence may be denoted by w,. Assuming as we tacitly have that the 
behavior of the system is statistically independent from race to race, 
the order in which wins occur in the sequence is irrelevant; only the 
total number w matters.? Accordingly, it seems reasonable for the 
bettor to make for some whole number A, the rule: 

If w>A, the next race is to be bet; if w< A, the next race is not to 
be bet. His problem is, then, to pick the number A,. 

The probability that w wins will occur in a sequence of n races, for 





’ The author recognizes that this postulate of independence assumes away what may be a big and 
crucial practical problem. 
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DOLLARS OOLLARS 











FIGURE 1 
EXPECTED INCOME FROM BETTING ON EVERY RACE 


which p is the probability of a win in a single race, is given by the 
binomial distribution function, 


nr 
(2.1) B(w; n, p) = (”) oa, 


Therefore, the probability of betting is, according to the rule, 


(2.2) Bw > A; n, p) = i (") ra, 


w=A+l 


The probability of not betting is, according to the rule, 


(2.3) B(w S A;n, p) = (") a 


Ww 


w=0 


At this point it is necessary to introduce Wald’s concept of weight 
functions which express the “loss” associated with erroneous decisions. 
Assume that the bettor bets every race. Figure 2 shows the weight 
function W(p) for this action. If p< po, he should not bet (as remarked 
in the discussion of the income function). Betting is an erroneous action 
to which there attaches a positive “loss” equal to Bg—ap. (Compare 
this to the income ap—q; only the sign is changed.) This is the loss 
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OOLLARS 


w(e)=Ba-Xo 











Pp ° 
FIGURE 2 
WEIGHT FUNCTION FOR BETTING ON EVERY RACE 


caused by betting when one should not bet. If p>po, the decision to 
bet is the correct one and no loss is incurred. 

Now assume that he decides not to bet at all. Figure 3 shows the 
weight function for this action. If p< po, not betting is the correct de- 
cision and no losses are incurred. But, if p> po, by not betting a possible 


income equal to ap—§q is given up. This amount is a positive “loss” 
from not betting when one should. At p=po, there are no losses as- 
sociated with either action. 


DOLLARS 


Wie)2 oC P-B 4 








w(O)=0 





e 
FIGURE 3 
WEIGHT FUNCTION FOR NOT BETTING ON EVERY RACE 
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The bettor now knows the weight functions which attach to each 
action and the probability of taking that action, given any value of p. 
Wald defines the risk function, which depends on p and the decision 
procedure (i.e., the rule) as the sum, over all the actions, of the prod- 
ucts of the weight function for each action and the respective proba- 
bility of taking that action, i.e., as the expected loss. Specifically, the 
risk function, R(p, A) is 


R(p, A) = (8q — ap)-B(w > A;n, p) when p& po 


(2.4) 
= (ap — Bq):B(w S A;n,p) when p2 po. 


OOLLARS 


RISK FUNCTION 











FIGURE 4 
GENERAL SHAPE OF THE RISK FUNCTION 


Figure 4 shows the general shape of this function. 

The maxim suggested by Wald is to pick that value of A for which, 
with p allowed to range over its value 0S pS, the maximum risk be- 
comes a minimum. In other words pick the value of A that would be 
best if the most unfavorable value of p were to prevail. The minimum 
value of the maximum risk will be denoted by min, max, R. For this 
reason Wald’s theory is sometimes referred to as the min max theory. 

For a fixed value of n, the shape of R changes as A is changed. For a 
small A (compared to n), the probability of betting is large; that of not 
betting is small. This means that the possible risk from betting is large; 
that from not betting is small. As A is increased, the possible risk from 
betting decreases and that from not betting increases. In other words, 
as A is made larger, the maximum risks associated with betting and 
not betting move oppositely until finally, when A is large (compared 
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ton), the possible risk from betting is small and that from not betting 
is large. There is therefore some value of A for which the maximum 
height of each part of F is at almost the same level.* And, since the two 
sections of the risk function move oppositely up and down as A is 
varied with fixed n, the absolute maximum will be as low as possible 
(minimized) when the maximums of the two sections are at the same 
level. Use will be made of this in Section 3 when the value of A is 
formally estimated. 


3. THE SOLUTION OF MIN4 MAX, R For A 


The risk function (2.4) is rewritten here as equation (3.1). 


n 


n 
R(p, n) = (8g — ap) > (") pea when p & po. 


w= A+1 
A 


n 
= (ap — Bq) > (”) a when p 2 Po. 


w=0 


(3.1) 


Using the normal approximation the risk function may be rewritten as 


Ai 
R(p, n) = (8q — ap): E — v( 2) when p S&S po. 
(3.2) “— 


A — np 
= (ap — a) -n (2? when p2 po, 
Vnpq 


where 


A — np 4 1 1 (A — np)? 
v( —*) = —_— exp| - dp 
V npg ~» V2a/npq 2 npq 


is an approximation to the cumulative binomial distribution. R must 
first be maximized with respect to p and then minimized with respect 
to A. To do this use is made of the idea at the end of Section 2, that the 
min, max, R will occur when A is chosen so that 


[or ons - (2) 
maxyp a aad seas 3 
ilies vnpq 


[oo — 60-»(“F*) | 
= max, ap— eo ° 
itis J/ npg 


(3.3) 





3 The discrete nature of the distribution of w may not allow exact equality. In this case, it would be 
possible to “split the difference” by using a “mixed strategy,” i.e., by letting the flip of a coin, or the like 
settle certain doubtful decisions. However, since this refinement does not seem worthwhile for a reason- 
ably large n, it is neglected in this paper. 
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That value of A which satisfies equation (3.4) can be found by numeri- 

cal methods using the normal probabilities from Volume 2 of “Tables 

of Probability Functions” published by the WPA, New York, 1942. 
The risk function (3.2) may be transformed as follows: 


Let 
(3.4) Pp = po t Ap, 


where po is that value of p (other than 0 or 1) for which R=0, and 
Ap is an increment of p, positive if p>go, and negative if p<pp. 
Further, let 


(3.5) A = Ao + AA, 


where A is that unknown value of A which truly minimizes the maxi- 
mum risk, Ao is equal to npo, and AA is an increment of A. Let /npq 
be approximated by +/npoqo=oo. (po is defined in 3.4; ga=1—po.) If 
now AA is taken to be zero, which means that A =npo, substituting 3.4 
and 3.5 into 3.2 will give 


ndp 
R~(at+ Aap 1 _ v( ) | when p S&S po. 


0 


(3.6) 
np 
~ (a+ pap: N ( ) when p2 po. 


To 
Letting nAp/oo equal ko, 3.6 becomes 


R~ al oo:(+ko)- [1 — N(ko)] when pS po. 
n 


(3.7) 


oe =< UE iets tek tee 


R may be maximized numerically as shown in Table 1. (Symmetry 
considerations allow —k» to be substituted for ko in the table with only 
a change in the signs of the first and third columns.) 


TABLE 1 
NUMERICAL MAXIMIZATION OF THE RISK FUNCTION 








Normal Deviate Probability a 
ko 1—N(ke) a ore 





0.7517 0 .2261157452 0. 1699712057 
0.7518 0.2260856710 0.1699712075 
0.7519 0. 2260555991 0.1699712049 
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Substituting the numerical values of the maximum into (3.7) gives 
R ~ 0.1699712(a@ + B)oo/n where pS po. 

~ 0.1699712(a + B)oo/n where p2 po. 


Thus it has been shown that for the maximum risks of each part of R 
to be equal (i.e., for the equation (3.3) to be satisfied) when the stand- 
ard deviation is approximated by ~/npoqo, 4A must be chosen equal 
to zero, or A equal to npo. 

The values of p at which the maxima occur are 


p & po + 0.751800/n, 


(3.8) 


which may be written, upon substituting »/npogo for ao, as 


(3.9) p & po + 0.7518+/poqo/ Vn. 


Similarly, the magnitude of the maximum risk is 


(3.10) ming max, R ~ 0.1699712(a + B)+/pogo/V/n. 


From (3.9) and (3.10) it is clear that as n becomes very large the 
min, max, R tends to become very small in proportion to 1/+/n, and 
R as a function to be concentrated more and more about p= po. 
Therefore, the solution to the problem is, within the range of the 
approximations used: 
If w>npo, bet; if wSnpo, do not bet. 


4. AN ILLUSTRATION 


The results of handicapping the 1948 Saratoga Meeting held at 
Jamaica, Long Island, from July 19 to July 31 inclusive, are used to 
illustrate the theory developed in Sections 1-3. The Daily Racing 
Form Consensus, published in the Daily Racing Form and other local 
newspapers, is used to select the most likely winner in each race. There 
were twelve days of racing and seven races each day. Of the eighty-four 
selections nine were scratched, leaving seventy-five races for this ex- 
ample. 

Three betting systems are proposed: 

System I. Bet every selection of the Consensus. 
System II. Assume a= $4, B=$2. Then, po =.33. 
Follow the rule of Section 3: 


Bet if w/n > .33. 
System III. This system is suggested by System II. 
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CHART I 
OPERATION OF THE THREE BETTING SYSTEMS 
Applied to 1948 Sorctoga Meeting at Jomaica 


40 







SYSTEM I R233 
Success Ratio(#)+ 
Roce Bet @ 

w 
(_) 
Oo 


SYSTEM I x=Bet 
system 1 ¢ Win, 
(The min max solution is not worked out; only the practical application 
to this set of races is given.) 
Dispersion in the odds from race to race is allowed for, and the question 
is asked: “At what odds would one be willing to bet?” 

Assume B= $2. Take p,, to be the observed success ratio w/n. Let 0, 
be the actual odds for each selection. Determine the income J such that 


B-I,, = 0. 
The critical odds O which correspond to J are 
I- 1 
ny oat Sear 
B Dw 


The rule for betting is: Bet if 0,,>0. 

As an example, suppose B= $2 and p,=}. Then, O=3. Only if the 
odds are greater than 3 to 1 will this selection be bet. 

The operation of each system is shown in Chart I. The results are 
summarized in Table 2. 


From equation (3.10), 
min, max, R ~ 0.1699712(2 + 4)/1/3-2/3/+/75, 
~ 0.055. 


For seventy-five races, the expected loss of System II is about $4.12. 
This compares with an actual loss of $8.00. System II would be ex- 
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pected to do better in the latter half of the races as n becomes large. It 
does exactly this since no race is bet after number 27. It may be ob- 
served, however, that there is not much excitement using System II in 
this example. System III shows a profit, probably because horses with 
very low odds are not bet. 

The seventy-five races show that Systems II and III are very simply 
applied in any practical situation. Furthermore, in this example, each 
does better than the plan to bet every race. 


TABLE 2 


SUMMARY OF RESULTS OF THE BETTING SYSTEMS APPLIED TO 
1948 SARATOGA MEETING AT JAMAICA 

















I II III 
No. of races bet 75 4 23 
No. of races won 20 0 4 
Total amount bet $ 150.00 $ 8.00 $46.00 
Total amount won 128.50 0.00 50.60 
Profit $—21.50 $—8.00 $ 4.60 





5. EXTENSIONS OF THE PROBLEM 


Several extensions of the simple problem treated in this paper sug- 
gest themselves immediately. A few will be posed briefly but not solved. 

1. The size of the bet is not restricted to $2. If the bettor can bet 
when and as much as he pleases from a finite purse, what should he do? 

2. The bettor may be allowed to make only one bet, or at most a few 
bets, if he bets at all (e.g., the Saturday player). He may make observa- 
tions during the week. If each observation costs 5¢, how many should 
he make and how should he proceed on Saturday? 

3. If the meet is of a finite span and the bettor can buy only one 
ticket per race and has lots of money, how should he proceed? 

4. Should w/n be calculated from all past experience or only a recent 
part of it? In general, how should the weight attached to an observation 
vary with its remoteness? If p is constant, the weight should not vary 
at all. If p varies (say from track to track), only observations from the 
current meeting should be used. 

Similar problems can be posed for situations not of a gambling char- 
acter. In sampling inspection in which the classification of the quality 
of an item is by attributes, i.e., into one of two classes, po corresponds 
to the acceptable-quality level (AQL). If the true percentage defective 
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p is near the AQL, the normal amount of inspection under the sampling 
plan initially introduced for the product is used. If the quality of prod- 
uct submitted is consistently better than the AQL, it may be desirable 
to reduce the amount of inspection and tolerate a higher risk of accept- 
ing lots of low quality, if submitted, because the evidence is that few 
such lots are submitted. If the quality of the product is consistently 
worse than the AQL, the amount of inspection may be increased to give 
more protection against the acceptance of inferior lots. The cost of not 
using reduced inspection when p< AQL or tightened inspection when 
p> AQL may be used in the min max theory to decide when to reduce 
or tighten the amount of sampling inspection.‘ Other examples will no 
doubt suggest themselves to the reader. 

The author is indebted to L. J. Savage for assistance with many of 
the technical details of the paper, and to talks with other members of 
the faculty of the University of Chicago about the general problem. 





4 See Statistical Research Group, “Sampling Inspection,” McGraw-Hill Book Company, Inc., New 
York, 1942, for a discussion of reduced and tightened inspection. 





INTERFERENCE WITH A CONTROLLED PROCESS 


Preston C. HAMMER 
Oregon State College* 


A model is established for consistent form of altering a proc- 
ess which would have been “in control” if left alone. This inter- 
ference has the expected effect of increasing the apparent 
standard deviation of the variable. For the model considered, 
all first and second order moments and the serial correlations 
are calculated. The limiting values of these moments are 
shown. 


INTRODUCTION 


PROCESS is said to be in control with respect to the production of a 
A certain quality characteristic measured by a variable z if a se- 
quence Zo, %1, - + - , 2, Of realizations of z might reasonably have been 
drawn at random from any fixed frequency distribution. Much has 
been said in the literature about controlled processes and in practical 
reports about lack of control in given instances. To our knowledge, 
however, no connection has heretofore been established between plausi- 
ble types of interference with random processes and serial correlations. 
The type of interference we idealize in this paper is but one of many 
possibilities which will immediately suggest themselves to the reader. 
We have chosen the particular kind of interference presented because 
it is plausible practically and because it is quite tractable mathemati- 
cally. 

We can best start off with an example. A machinist makes a bushing 
with a nominal outer diameter of a inches. Let us assume that once his 
initial machine settings are made the outer diameter measurements x 
would be “in control,” producing parts with a mean diameter of, say 
mo inches and a standard deviation o inches. Now suppose he produces 
a first bushing and measures its diameter. He finds it to be zo inches 
and then proceeds to adjust the machine setting in view of this ob- 
served reading. Such an adjustment would tend to compensate for the 
difference x»—a so we shall assume that the machinist has made the 
adjustment such that the mean diameter of parts thereafter produced 
would be m= mo —c(xo—a) where c is some positive constant indicating 
the degree of interference or reaction. At first the machinist might set 
to compensate exactly for the difference x»—a; that is, then we would 
have c=1. We shall make the simplifying assumption that the inter- 





1 Now at the Los Alamos Scientific Laboratory. 
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ference leaves the basic frequency distribution unchanged save for 
shifts of the mean value. We now envisage a machinist who repeatedly 
adjusts his machine in view of new measurements, according to the 
formula m4:=m,—c(%,—a@) where 2; is the last observed value of z 
and m, is the mean of the frequency distribution from which 2; is a 
random selection. We do not need to assume that the machinist reacts 
to every measurement but merely that his reaction always takes the 
form specified and that the process without interference would have 
been “in control.” It is also clear that no restriction need be made on 
the derivation of variates z,. They could be averages of dimensions, 
standard deviations of groups of variates, or any other stochastic varia- 
bles subject to the sequential conditions imposed. 

Granted such a set of hypotheses, what does one wish to prove? It is 
quite clear that successive variates are not independent so the serial 
correlation coefficients should be interesting. Under certain conditions, 
it is still possible to assign control limits to z,, although the successive 
variates are not independent. We shall find a measure of the apparent 
increase in the standard deviation and also several serial correlation 
coefficients. These coefficients suggest certain large sample tests for 
interference of the type postulated. Some desired tests appear quite 
difficult to construct. 


II. FORMULATION OF PROBLEM 


Let F(&) be a cumulative distribution function of a random variable 
¢ with mean zero and standard deviation oc. Let £, &, -- + &,- +--+ be 
a sequence of statistically independent random variables distributed 
according to F(). Now let a be a desired mean value and let c be a 
positive number. The first mean we take to be mo. Then m, is defined 
by the equation 


(1) m = mMm-1 — C(e-1 aaa a) k= i, 2, Sigere 
where 2,-_; is the value of the kth variate and 


(2) Le-1 — Mey = Fe-1. 


We assume m,_; and £_, to be statistically independent variables. 
Substituting from (2) for z,_; in (1) and repeating, we find 


mz = (1 — c)*(mo — a) +a — elf + (1 — cas 
+ (1 — 2)*(f&s) +--+ + (1 — co] 


and as 7% =&-+m, we also have 


(3) 
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a, = (1 —c)*(mo —a) tat+& —cl&it (l—ch&eet::: 


4 

P + (1 — o)£5]. 

This shows both m, and 2; as linear functions of the mutually inde- 
pendent variables £, - - - , & and hence we may calculate various pa- 


rameters of the distributions of m, and x; quite readily. 

If there had been no interference, i.e., c=0, observe that m,=mo and 
t,.=mot+é. If the “natural” adjustment c=1 had been used, then 
m,=a—£,-1 and 2,=a+&—£_1, from which it appears that 2; is inde- 
pendent of 24-2. 


III. FORMULAS FOR VARIOUS EXPECTED VALUES 
Using equations (1) and (3) we find the following expected values 
where we must take c<2. 


(1) E(x.) = E(m,) = (1 — c)*(mo — a) + 














(2) a= -”. 
C:,' = 
’ 2-—Cc 
c 
(3) om," = 2-c {1 = (1 - c)** |o? = Cas" —o’ 
tenga wa ae 
Os,-,F 22 O 2,10 rp 
.. a 3, — P 
(5) eT ee nj — 00" x4-5) j=2,3,4,---,k 
Ox, -jF xp 
(6) Pzym, = Cu, /Co, 
(7) Pam; = (1 = C)4om,_;/F x, j = ;, 2, ese k-1 
1 — c)*"(o7%m,_, — Co*2,_; 
(8) Pu,gz,-; ™ \ — = 2. mole i) j= 1, 2, . 8 
Om, —j Tm, 
(9) Pmym,-; = (1 = C)4om,—;/Fm, j = - 2, Pe k-1 


These formulas give all conceivable second order moments. Observe 
that if c=1, o2,2=207=0?+om,?. Hence, if c=1, the variance of 2; is 
equally due to its “natural” variation and to the variations caused by 
the interference. Also the serial correlation p.,:,_, for c=1 becomes 
—4. We have already noted the statistical independence of x, and 
%-2 when c=1. When c=0, o:,2=0? and om,?=0 as expected. 
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Iv. ASYMPTOTIC FORMULAS 


The formulas of paragraph III are unwieldly for use but the asymp- 
totic formulas given below would be satisfactory from the standpoint 
of testing generally. In order to derive limits, it is necessary that 
0<c<2. Then we find the following formulas: 


(10) lim E(2,) = lim E(m) = a 
(11) lim oz,? = 207/(2 — c) 
(12) lim om,? = co?/(2 — c) 
(13) lim Pam-, ~*~ ~ c/2 
c 

(14) lim Pan; = — 2 (1 ia c)#-! j ” 2, 3, an a 

rr 
(15) lim pzym, = 9 

r~ 

(16) lim pzym,-; = (1 — oi4/ j=1,2,---,k-1 
(17) lim pm,2,-; = — (1 — ce)! j=1,2,---,k 
(18) lim pm,Pm,-; = (1 — ¢)? j3=1,2,---,k-1. 


As c approaches zero o:,? approaches o? and om,? approaches 0. 
Formulas (17) and (18) do not hold for c=0 but the values would be 
equal to 0 and 1 respectively as m,=mo a constant. Formula (13) is 
interesting as it displays our constant “interference” factor as a func- 
tion of the serial correlation between x, and its predecessor. Denoting 
this limiting serial correlation by p1= —c/2 we have 


(19) lim o2,? = o?/(1 + px) 

(20) fen dens? > —enhth + ad 

and 

(21) lim pzy2,-. = p2 = — pi(l + 2p). 


We introduce “p2” here to indicate the serial correlation coefficient 
of lag 2. The problems of formulating various tests may be considered 
in several forms. One may consider a test for the presence of inter- 
ference, assuming that the model proposed is adequate. This might 
assume the form of establishing that p:<0 or that the hypothesis that 
pi=0 is quite likely false. If interference is present in the form specified 
then estimating p; and its confidence limits in order to find an approxi- 
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mation to the interference factor c would be to the point. On the other 
hand, one may question the adequacy of the predicted interference 
type and in this case, for large samples, one could calculate r; and r2 as 
estimates of p; and p2 and see if Equation (21) is “approximately” satis- 
fied. 

Observe that if c<0, divergent expected values of x; and m, are ob- 
tained unless mo =a. If the interference coincides with c= 1 and if z; is a 
mean of groups of two variates, the apparent standard deviation of 2, 
is about the same as it would have been for the individual values with- 
out interference, assuming control. Hence, if this type of adjustment 
(c=1) is to be made consistently, the number of variates averaged 
should be greater than 2 if any reduction in the apparent standard 
deviation is desired. The over-compensating interference c>2 produces 
oscillating expected values of x, and m, and there is no bound to their 
standard deviations as k increases. 

The accompanying figures? show some of the implications of the type 
of interference predicated. In Figure 1 is depicted lim o,,2/0?=2/(2—c) 
showing how the effective variance is increased by the interference. In 
Figures 2-5 are shown the limiting serial correlation coefficient of lag 
1, 2, 3, and 4 respectively as functions of the interference factor. Note 





? Prepared by Charles A. Lehman. 
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that at the “natural” interference c=1 the correlation coefficients of 
lags 2, 3, and 4 are zero in accord with our statement that in this case 
2x; is independent of x,_2 and its predecessors. As c approaches the “com- 
plete” over-adjustment value 2 the correlations all approach one or 
minus one depending on the oddness or evenness of the lag. This is 
merely a reflection of the fact that at c=2 we produce violent oscilla- 
tions in the sequence {2;}. 


Vv. ASSUMPTION OF NORMALITY. LIMITING DISTRIBUTION 


If the cumulative distribution function F(é) is normal, then the dis- 
tributions of 2, and m, are normal with parameters as given in III and 
if furthermore, 0<c<2, then the asymptotic distributions of these 
variables exist and are normal with parameters as given in IV. 

If we assume that F'(£) has finite moments of all orders, then standard 
limit formulas show that if 0<c<2, the asymptotic distributions of 
x, and m, exist and have the moments given in IV. (See, for example, 
Kendall, Advanced Theory of Statistics, Vol. 1, pp. 101-102.) 


VI. CONCLUSION 


Assuming a certain systematic type of interference with a controlled 
process, we have shown the effect of this interference on the variance 
of the variable and indicated how one may test for the existence of this 
type of interference. 
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SAMPLE SIZE REQUIRED FOR ESTIMATING THE 
STANDARD DEVIATION AS A PER 
CENT OF ITS TRUE VALUE 


JoserpH A. GREENWOOD 
AND 


Marion M. SANDOMIRE 
Navy Department, Washington, D. C.* 


One frequently encounters the need of a rational selection of 
sample size when it is desired to estimate the standard devia- 
tion. Changing the permissible error of the estimate from an 
absolute to a relative one is acceptable in many cases and per- 
mits an exact, a priori solution to the problem of sample size 
without involving any previous estimates. 


HERE ARE many practical engineering situations in which an esti- 

mate of the linear dispersion of a characteristic is desired. Examples 
of such are longitudinal or range error of a low-altitude bomb sight, or 
errors of a measuring device. Experience in working with the engineer 
has shown that 1) he grasps the idea of a standard deviation as a meas- 
ure of dispersion; 2) he accepts the concept of expressing a sample 
standard deviation as being within a previously agreed-upon percentage 
of its true value for the normal population; 3) he has enough intuitive 
understanding of a confidence coefficient to be willing to take action 
accordingly. Thus, a quick means of telling him the required sample 
size for obtaining estimates within various confidence intervals for dif- 
ferent confidence coefficients has been found useful. These estimates 
are those in which the half-length of the confidence interval about the 
true standard deviation is expressed as a percentage of the true stand- 
ard deviation. The proposed solution for the required sample size for 
estimating this does not utilize any previous estimate of dispersion or 
its true value, and thus is widely applicable. 

Let it be assumed that a normal population is being sampled. Let s? 
be an estimate of the squared standard deviation of the population, o?, 
such that ns?/o? is distributed as x? with n degrees of freedom. Then 
the average value of s? will be E(s?)=o?, where o? is the true, but un- 
known, population variance. Let 0<u<1. The proportion of the time 
that s lies within a given fraction u of o will be known if we know the 
prob{s>(1+u)c} =p, and the prob {s<(1—u)o} = pr. 

The values of p; and p2 were obtained through the following relation. 





* The opinions herein are not necessarily those of the Navy Department or the Naval Service at 
large. 
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ESTIMATING STANDARD DEVIATION 


When s>(1+4u)o, the quantity ns?/o?>n(1+u)*. Thus, n(1+wu)? is 
that value of x,? such that the prob {x,?>n(1+u)?} =p;. Similarly, 
n(1—u)? is that value of x,? such that the prob { Xn?<n(1—u)?} =o. 
Convenient values of n and wu were selected and these probabilities 
were computed. Then points forming the curve for a constant value of 
u were plotted with coordinates (l—p:i—pe2) on the confidence-coeffi- 
cient axis, and n on the degrees-of-freedom axis. In Figure 1, w is 
changed to per cent P. 

When n $100, linear interpolation between the logarithms of proba- 
bilities in the Thompson tables [1] was used. When n> 100, the Wilson- 
Hilferty formula [2] 


3 = n(1 2 oe =) 
— 9n ” 9n 


was used to find the corresponding normal deviate y,. It is clear from 
the graph that when any two of the three variables, P, degrees of free- 
dom, and confidence coefficient, are given, the third variable is readily 
determined. 

Sample size is determined from the number of degrees of freedom 
read and the considerations entering into the original design of the ex- 
periment. In a simple replicated test, sample size is greater by one than 
the number of degrees of freedom. In a more complex, multi-factor ar- 
rangement, the degrees of freedom obtained from the graph are con- 
sidered as those corresponding to the residual error, and a sufficient 
number of measurements plus one must be added thereto to allow for 
the estimates associated with each of the main factors and their inter- 
actions as prescribed by the original design. In planning an experiment 
for estimating the standard deviation, the loss in this way of degrees of 
freedom, leading to an increase in total sample size, should be balanced 
against the need for the additional information to be gained from the 
multiple classification. In such cases the assumption must be satisfied 
concerning the homogeneity of the set of population variances pertain- 
ing to the different groupings. 

Example 1: A series of radar pulses is to be sent out to a target and 
the strength of the return signal measured. How many readings under 
identical conditions shall be taken so that the standard deviation of the 
return signal strengths shall, with 0.80 confidence, be within 10 per 
cent of the true value? Solution—From the graph it is seen that n is 83. 
Sample size, in this case one greater than the degrees of freedom, is 84. 

Example 2: How many bombs shall each of 6 bombardiers drop at a 
target in order that an average bombardier’s standard deviation for 
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horizontal range shall, with 0.90 confidence, be within 15 per cent of 
the true standard deviation? Solution—From the graph it is seen that 
2=60. Then each of 6 bombardiers would contribute 10 degrees of 
freedom, or would drop 11 bombs. This results in a total of 66 bombs to 
be dropped. 

It was considered of interest to compare the graphical results with a 
distribution of estimates that could be made from a set of random num- 
bers. Dodd’s table [3] contains 800 (in 16 columns of 50) “almost nor- 
mally-distributed deviates” in random order, with an average close to 
zero (—.016) and a standard deviation near 1 (.993). If a proposed 
problem be one of determining the standard deviation to within 10 per 
cent of its true value, half of the time, Figure 1 indicates that n = 24, or 
samples of 25 are required. Dodd’s table furnished 32 samples of 25 
values, for which standard deviations were calculated, and then con- 
verted to percentage errors of the true value of 1. It was found that 16, 
or just one-half, of these values were not over +10 per cent. In other 
words, estimates within 10 per cent of the true value were obtained 
half of the time. 

A horizontal line of Figure 1 provides a series of distribution points 
for the expected frequency of errors obtained from samples of a given 
size. For samples of 25, the following are the expected frequencies for 
various errors, and the proportion calculated from the set of 32: 








Maximum Error Expected Observed Frequency 
in Estimate Frequency, Per Cent, in 
of a, Per Cent Per Cent 32 Samples 





.50 
.69 
81 
91 
.97 
1.00 
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ESTIMATING BIRTH REGISTRATION COMPLETENESS 


Sam SHaprro 
Natality Analysis Branch, National Office of Vital Statistics 


A nation-wide test on the completeness of birth registration 
was carried out in 1940 in connection with the Decennial 
Census of Population and Housing. The present paper dis- 
cusses the comparison, based on this data, of two methods of 
obtaining per cent completeness of birth registration by states: 
1) by relating a matched set of records for the state as a whole 
to the total group of matched and unmatched records com- 
bined; and 2) by a cumulative technique suggested by Chan- 
dra Sekar and Deming in the March issue of the Journal. 
Differences in the results by the two methods were minor ex- 
cept in those areas having a comparatively high degree of 
under-registration. 


HE recent article, “On a Method of Estimating Birth and Death 

Rates and the Extent of Registration,”! has been read with con- 
siderable interest at the National Office of Vital Statistics, U. S. Public 
Health Service, in view of its responsibility for determining the com- 
pleteness of registration of vital events in this country. 

In 1940, while the Office was within the Bureau of the Census, a 
nation-wide test on birth registration completeness was carried out in 
conjunction with the Decennial Census of Population and Housing. 
The general procedure for determining measures of registration com- 
pleteness by various characteristics was basically the same as described 
in the Chandra Sekar and Deming article. Infant cards were filled out 
by census enumerators for all enumerated children born during the 
period December 1, 1939, to March 31, 1940. Birth records on file for 
infants born during this period were matched against: (a) the infant 
cards and (b) a set of death records on file for children whose birthdates 
were within the test period but who died before the census date (April 1, 
1940) .? 

The residual group of unmatched infant cards and death records 
represented “unregistered” children. The percentage of registration 
completeness in an area was derived by relating the matched number 
of records to the total number of infant cards and death records in the 
area. Birth registration was found to be 92.5 per cent complete for the 





1 By Drs. Chandra Sekar and Deming, published in Vol. 44, No. 245, March, 1949, Journol of 
the American Statistical A lati 

2 For a statement on test procedure see “Studies in Completeness of Birth Registration,” Bureau 
of the Census, Vital Statistics—Special Reports, vol. 17, no. 18, 1943. 
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United States as a whole, but completeness in the States varied from 
75.9 per cent to 99.4 per cent. Far greater variability existed among 
counties and other local areas within States. 

Much attention was given to exploring the possible effect of incom- 
pleteness of infant enumeration in the census on the percentages of 
birth registration completeness.* In the absence of an opportunity to 
recanvass selected areas, tables were prepared to determine the limits 
of the bias in the unenumerated group under certain assumptions of 
the degree of positive correlation between the unregistered and un- 
enumerated events. The tables suggested that in all likelihood the per- 
centages of registration completeness were affected only slightly by 
failure to enumerate all infants. This conclusion was not a very satis- 
fying one because of the uncertainty of the limits of error in specific 
areas and the inability to determine correction factors. 

The article by Chandra Sekar and Deming appears to present a 
feasible method for systematically reducing the effect of correlation 
between unregistered and unenumerated events on measures of regis- 
tration completeness. The basic objective in the method is to subdivide 
an area (either geographically or by a combination of characteristics) 
into subgroups each of which is highly homogeneous with respect to 
enumeration completeness.‘ Within such subgroups, the correlation be- 
tween unregistered and unenumerated events would be very low. An 
estimate of the total number of registered and unregistered births in 
the area, approximating the unbiased estimate, could then be derived 
by cumulating the total number of births corrected for under-registra- 
tion in each subgroup. 

This Office has applied the method developed in the article to data 
available from the 1940 Birth Registration Test. For each State, com- 
parisons were made between: (1) the percentage of registration com- 
pleteness derived from matched and unmatched records for the State 
as a whole and (2) the percentage obtained by cumulating estimates of 
the total number of births (registered and unregistered combined) in 
geographic subdivisions of the State by race.’ In method 2, it was 
known how many white and nonwhite births were registered in indi- 
vidual cities of 10,000 or more population within each county of a State 
and in the balance of the county. Percentages of registration complete- 
ness available from the birth registration test for each of these sub- 





3 Registration of infant deaths was also known to be incomplete, but this factor almost certainly 
represented a far less important source of bias in most areas than incompleteness of infant enumeration. 

4 In terms of the article, a completely homogeneous population would be one in which each event 
had an equal probability of being enumerated. 

5 Registration completeness data for “white” and “nonwhite” race groups within geographic sub- 
divisions were used in those States with 10 per cent or more nonwhite population. 
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TABLE I 


COMPARISON OF PERCENTAGES OF REGISTRATION COMPLETENESS DETERMINED 
BY TWO METHODS: UNITED STATES AND EACH STATE, 1940 TEST 


(Arranged in rank order) 








Percentages Derived by Percentages Derived by 
Difference Difference 
Method (1) Method (2) Method (1) Method (2) 
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NOTE: Method 1 consists of relating a matched set of records for the State 
as a whole to the total group of matched and unmatched records combined. In 
method 2 new bases for State percentages of registration completeness are ob- 
tained by the cumulative technique suggested in the article. Geographic and 
race subgroups are used in this cumulative process. 


groups were divided into the corresponding registered birth figures. The 
quotients represented estimates of the total number of births corrected 
for under-registration in specific subdivisions of the counties.* These 
were cumulated to obtain the total number of births for the State. 





* Under the assumption that each subdivision is completely homogeneous with respect to enumera- 
tion completeness, each quotient represents an unbiased estimate (N) of the total number of births in 
the subdivision: 

" C+M™M 
N= 
C/(C + Ns) 
This is equivalent to the unbiased estimate (C +N1+N:+N.N:/C) given by Chandra Sekar and Deming 


(op. cit., p. 102) where C = number of matched records, and Ni =number of unmatched birth records, 
and N;=number of unmatched infant cards and death records. 
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Finally, the number of registered births in the State was divided by 
this figure. The result was taken as the new measure of registration 
completeness in the State. 

Percentages of registration completeness for each State and the Dis- 
trict of Columbia computed by methods (1) and (2) are given in Table I. 

It will be noted that the effect of cumulating subtotals is very minor 
in practically all States with registration completeness over 90 per cent. 
A difference of 1 per cent or more between the two percentages occurs 
in only 11 States. The five states having differences of two per cent or 
more had the lowest percentages of registration completeness in the 
country. In 32 States, method 2 gives a lower percentage of registration 
completeness than method 1. In only 4 areas, were percentages based 
on cumulated figures higher than the others. However, these differ- 
ences were all very small. 

It is possible that other cross-classifications of the 1940 test data 
would result in greater differences between percentages obtained 
through method 1 and the cumulative technique suggested by Chandra 
Sekar and Deming. Further experimentation is being carried out with 
subgroups based on such characteristics as occupation of father, educa- 
tion of mother, and race, and whether the birth occurred in or out of a 
hospital. The findings are of special interest at this time because of the 


plans under way for conducting another Nation-wide test of birth 
registration completeness in 1950. It may well be that the cumulative 
method will have an appreciable effect on measures of registration 
completeness only in those areas with a comparatively high degree of 
under-registration. Nevertheless, this method is important as a practical 
approach for determining the bias in measures of registration complete- 
ness which can be reduced by statistical means. 





THE DEGREE OF STEREOTYPY 


Joun E. FREuND 
Alfred University, Alfred, N. Y. 


A descriptive measure of the distribution of responses in 
multi-choice situations is defined as a function of the proba- 
bilities of the various choices. The moments of this parameter, 
called the Degree of Stereotypy, are considered, and the pa- 
rameter compared with other measures of stereotypy. 


I 


MPORTANT PROBLEMS in psychological and educational analysis deal 

with the study of responses in multi-choice situations. Such studies 
usually investigate the frequencies with which responses are distrib- 
uted within a class of alternative responses. It is our purpose to develop 
in this paper a descriptive measure of the distribution of these responses 
which we shall call the Degree of Stereotypy. The usefulness of this 
measure is, of course, not limited to psychological and educational ques- 
tions, but since the problem was first posed by psychologists,' we shall 
discuss its importance and interpretation with reference to these par- 
ticular applications. 

Let us consider for example an experiment in which the subject has 
the choice of n different courses of action (i.e., in a study of learning 
where rats in a maze have the choice between n different paths, or in 
the analysis of a multiple-choice question which permits n different 
alternative answers). If the experiment is performed on WN subjects or 
on the same subject N times, we obtain the frequencies z; with which 
the various alternatives have been chosen (i= 1, 2, - - - n). In the study 
of the stereotypy of responses it is not essential to know the actual 
values of the x; or their expected values Np;, but it is the variation be- 
tween the p;, the probabilities of the various alternatives, which is of 
primary importance. If the p; are all equal, we would say that the be- 
havior is non-stereotyped, or in statistical language we would say that 
the distribution of the p’s is uniform, i.e., every alternative has the 
same probability of being chosen. If on the other hand one of the p’s 
equals 1, while ali others equal 0, we have a completely stereotyped 
response, since one of the alternatives is chosen every time. Between 
these two extremes there are various degrees of stereotypy, depending 





1 We are greatly indebted to Dr. 8. C. Clark of the Dept. of Psychology of Alfred University, who 
brought this problem to our attention and who pointed out to us some of the work which had recently 
been done in this field. 
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on the distribution of the p;. If we limit ourselves to a finite number of 
alternative responses, stereotypy will be a function of the parameters p; 
of a multinomial distribution. It is important to note, therefore, that 
stereotypy is itself a parameter of a theoretical distribution. We shall 
denote it by ¢ and define it as 


n 1 2 
>= - o(»-—). (1) 
n 


2 = 1 t=] 





This definition is, of course, arbitrary, but so is the choice of most pa- 
rameters of statistical distributions. We have chosen the above defini- 
tion of @ because it seems to describe what is commonly meant by 
stereotypy, besides having the following advantages: 


a) If all the p; are equal, then ¢=0 

b) If one of the p’s equals 1 and all others equal 0, then ¢=1 

c) ¢ is restricted to the interval from 0 to 1 

d) ¢ is a constant times the variance of the p’s, which makes it rela- 
tively easy to compute its moments. 


II 


Having given a definition of ¢ in terms of the p; of a multinomial dis- 
tribution, the question now arises, how ¢ is to be estimated from any 
given set of observational data concerning a multi-choice situation. It 
can easily be shown that the statistic 








n " N+n-1 ; 
G@oDw spy et ~ Gowen’ - 


where 7 is the number of alternatives, N the sample size and z; the 
frequency with which the 7th alternative has been chosen, is an un- 
biased estimate of ¢. We shall call this estimate the Degree of Stereotypy 
and denote it by the symbol Ds. 

If we let f; stand for the fraction of the total cases which fall in the 
ith class, namely if we put f;=2;/N, then (2) will reduce to 


nN Ld , N+n-1 
“Gopwepe~G@opweD 








(3) 


Ds 


For large samples this formula can be simplified to 





2 Another measure of stereotypy, the Index of behavioral stereotypy was recently defined by G. Miller 
and F. Frick in “Statistical Behavioristics and Sequences of Responses,” Psychological Review, Vol. 56, 
No. 6. 














E 1950 


ber of 
ers p; 
’ that 
: Shall 


(1) 


st pa- 
efini- 
it by 


rela- 


dis- 
any 
. It 
(2) 
the 


{Py 


the 





DEGREE OF STEREOTYPY 267 


(4) 








—lia -1 
In order to construct cation tests, confidence limits, etc., it is 
essential to know at least the standard deviation of this new statistic. 
We shall derive an approximate formula for the variance of Dg for 
large samples, although the same method will, of course, give us also an 


exact formula for small samples. 
Let us first consider the statistic D’, where 


D' = > fe. (5) 
ian] 
The expected values of the first two powers of D’ under repeated 
sampling from the same multinomial distribution will then be 


B(D!) = > BV) 
— (6) 
BD") = > D BUA. 


Since we can write the first moment squared as 


[E(D) ? = LL DL EGA) ES) 
im] j=l 
we now have 
=> Dd (EG) — EGP)E(?)). (7) 
i=] jal 
Using the moment generating function of the multinomial distribution 
and taking partial derivatives in respect to the 6; when all 6;=0, we 


obtain 





a°M 
N°E(f;?) = = N+ NW - 1)p;? (8) 
a, 
NE (fi 4) = 0 aad Np + 7N(N i 1)p,? 
+ 6N(N — 1)(N —2)p3 
+ N(N — 1)(N — 2)(N — 3)pi* (9) 
4 
‘E(f2f2) = = N(N — 1)pip; 
NBA) = sera = NUN ~ De 


+ N(N — 1)(N — 2)[pipi? + Di*p;] 
+ N(N — 1)(N — 2)(N — 8)pi?p?. (10) 
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An exact formula for the variance of D’ could now be obtained by 
substituting the results of (8), (9) and (10) into expression (7). We 
shall approximate these moments, however, by disregarding the terms 
which contain a power of N in the denominator, which is greater than 1. 
Expressions (8), (9) and (10) may then be approximated as 


ic dag 
eet in N 


N -6 





pi? (8’) 





6 
E(f) = =p? + 


i! Q’ 
v Pp (9’) 


and 





1 N -—6 
E(f#f;) = V (pips? + pi?p;) + pi*p?. (10’) 


Substituting these expressions into (7), we now have 
co = = 3 (pi? — pe) —— 3D pepe, (11) 
i=] fowl j=l 


This expression can be simplified to 
n 2 
-—{> Ld pi -| Zz P| (12) 
ial t=] 


"a om 312 2d pi -| > p*| (13) 


which gives us a good approximation of the variance of the Degree of 
Stereotypy Ds. The standard deviation of Ds can therefore be ex- 
pressed (approximated) easily in terms of the f; cf a sample. 


and we finally have 


2 





TDs 


III 


There is a slight similarity between our Degree of Stereotypy and C. 
Gini’s “coefficient of concentration,”* as both of these statistics attempt 
to measure the concentration of the probabilities belonging to a number 
of different classifications. Whereas Gini’s measure can be used only for 
the description of a distribution of a numerical, i.e., an ordered variable, 
the Degree of Stereotypy can be used also for categorical distributions. 
It is here where we find its greatest usefulness. 





3 See M. G. Kendall, “Advanced Theory of Statistics,” Vol. I, page 43. 
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Another measure of stereotypy, which also measures the concentra- 
tion or spread of the probabilities of an unordered series is Miller and 
Frick’s “Index of behavioral stereotypy.”4 This index is defined as 


C=1-—k)> p; log p; (14) 
t=] 

where the constant k is chosen in such a manner that C=0 when all 
the p; are equal. This index, which incidentally might, due to its struc- 
ture, also be called the “entropy” of a distribution, is somewhat similar 
to what we denoted by ¢, the stereotypy of a distribution. Both C and @ 
are defined in terms of the parameters p; of a multinomial distribution 
and they have properties which are similar in many respects. 

Our preference for ¢ and its corresponding unbiased estimate Dg is 
based on primarily pragmatic reasons. The structure of C (14) makes it 
difficult to formulate a function of the sample frequencies f; which 
would give us an unbiased estimate of C. Similarly it would be ex- 
tremely difficult to find the higher moments of any such statistic.5 

Another advantage of ¢ is that it is more discriminating, i.e., that it 
does not go to zero as fast as C. This is shown, for example, in Table I, 
which gives the values of ¢ and C for various combinations of the p; in 
the special case where there are only two alternatives. 











TABLE I 
Value of the p’s d C 
1.0 and 0.0 1.00 1.00 
a * 1 .64 .52 
a” « .36 .26 
. .16 .12 
 * 4 .04 .03 
me 5 .00 .00 








4 See footnote (2). 

5 If Miller and Frick intended C to be a function of the sample frequencies instead of the theoretical 
parameters p;, they did not mention its relation to the theoretical parameters of the multinomial dis- 
tribution, i.e., they did not even show its expected value. 
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PROCEEDINGS 


AMERICAN STATISTICAL ASSOCIATION 
109TH ANNUAL MEETING 


HOTEL BILTMORE, NEW YORK, NEW YORK 
MINUTES OF THE ANNUAL BUSINESS MEETING 


The American Statistical Association convened for its 109th Annual Meeting 
on the evening of December 27 at the Biltmore Hotel, New York City. A motion 
was made and passed to approve the minutes of the last annual business meet- 
ing, held at the Hotel Statler in Cleveland, Ohio, on December 28, 1948, as they 
were printed in the June 1949 issue of the Journal of the American Statistical 
Association. 


Report of the Committee on Fellows 


Harold Hotelling, reporting as Chairman of the Committee on Fellows, stated 
that: 

In carrying out the constitutional prescription of an annual survey of the mem- 
bership of the Association, the committee has come upon the names of statis- 
ticians who are clearly distinguished, but who have never been elected to Fellow- 
ship, presumably because of their residence overseas. The practice of successive 
committees has been to elect to Fellowship no one living outside the United States 
and Canada, and strong reasons, chiefly the difficulty of obtaining information, 
could be adduced for this practice. Improved communications and the increasing 
internationalization of statistics have, however, changed the situation. The 
committee, after a study of the problem, now desires to record its unanimous 
conviction that foreign members should be honored by election to Fellowship on 
the same basis as those living here. Since this conclusion was reached late in the 
year, the committee refrains from announcing at this time any list of foreign 
members elected to Fellowship. 

The committee announces the election as Fellows of the following nineteen 
American members: 

THEODORE W. ANDERSON, mathematical statistician of distinction, con- 
tributor to multivariate statistical theory, who has made fruitful excursions into 
wartime research carried out under the seal and later into economics. The new 
editor of the Annals of Mathematical Statistics. 

WALTER BARTKY, whose statistical competence has enabled him to con- 
tribute to the improvement of methods of industrial quality control, to conduct 
important wartime researches, to help in his capacity of Dean at a great univer- 
sity to guide the sound development of statistical teaching, to take an active 
part in committee work including the production of one of the recent reports on 
the teaching of statistics—and even to teach statistics to students of astronomy. 

DOROTHY BRADY, important for her work on surveys of family budgets, 
family income, and statistical studies of such data. 

FRANCIS G. CORNELL, chief statistician of the United States Office of 
Education, Chief of the Education Research Staff cf the U. 8. Senate Committee 
on Labor and Education and now director of the University of Illinois Bureau of 
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Educational Research, who has contributed greatly in writing and as a teacher 
to the development and application of statistics and its methods. 

HAROLD F. DODGE, leader in the theory and practice of acceptance sam- 
pling, meaningful specifications of materials and tests of performance, sampling 
of industrial materials, and statistical control of quality. 

SOLOMON FABRICANT, well known for his distinguished work on the sta- 
tistics of production, productivity and capital consumption. 

WILL FELLER, mathematician, contributor to knowledge regarding limit 
laws of probability, and to the theory of renewal of human populations and of in- 
dustrial aggregates. Former president of the Institute of Mathematical Statistics. 
Former editor of Mathematical Reviews. 

MILTON FRIEDMAN, economist who has skillfully applied both quan- 
titative and other methods, not only to add to the science of economics, but under 
the call of wartime urgency, to help design metallurgical experiments and partici- 
pate in the design of weapons and tactics. 

FRANK R. GARFIELD, who has developed numerous significant improve- 
ments in the measurement of industrial production and current business activity 
and in the methods of organizing such measurements for purposes of analyzing 
the current business outlook. 

MARGARET J. HAGOOD, leader in surveys and studies of rural sociology, 
employment, unemployment, occupational classifications, and theory of sam- 
pling. 

HILDEGARD KNEELAND, outstanding worker in the field of statistics of 
income distribution. 

RENSIS LIKERT, who has improved the reliability and validity of statisti- 
cal data through improved questionnaires, improved methods of interviewing, 
improved methods of selecting and training interviewers, and improved methods 
of sampling. 

FREDERICK A. MOSTELLER, who has contributed to basic statistical 
methods and theory, who has introduced improved statistical techniques in fields 
of social research, and who has participated in wartime statistical contributions 
to the great common effort. 

JOSEPH J. SPENGLER, economist and able student of the statistical prob- 
lems of human populations. 

DONALD 8S. THOMPSON, who has done distinguished work in the develop- 
ment of improved statistical information in the fields of banking and finance. 

WARREN THOMPSON, leader in research into human population prob- 
lems, long an important interest of the Association. 

LOUIS L. THURSTONE, active worker in the field of mental testing and 
personnel placement, leader in the dissemination of ideas and methods related 
to matrices of correlations, experimenter in the actual determination by psycho- 
physical methods of those indifference surfaces which are basic to much economic 
theory. 

JOHN W. TUKEY, mathematician, statistician, penetrating critic, expert in 
quality control, ballistics, and other of the encyclopedia of subjects which are the 
lot of the statistician. 

CHARLES P. WINSOR, biometrician and editor of Human Biology, war re- 
search statistician, wise counsellor and teacher. 

President Kuznets expressed his feeling of pleasant surprise at the large num- 
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ber of Fellows elected unanimously by the Committee on Fellows and presented 
by Professor Hotelling for the information of the membership. In view of the 
change in policy toward the election of non-American Fellows which Professor 
Hotelling announced, President Kuznets threw the floor open for discussion, but 
found no opposition to the new policy. 


Report of the Board of Directors 


Retiring Director Isador Lubin, speaking for the entire Board of Directors, 
read the following report: 

During 1949 your Board of Directors was primarily concerned with three cen- 
tral problems: (1) the finances of the organization, (2) the problems of publica- 
tion, (3) the proper service by the Association to the diverse interests of its mem- 
bership. 

The financial problem was most acute and required early consideration be- 
cause in 1948 the expanded program of the Association, combined with increased 
printing costs, resulted in an operating deficit of $13,000. 

At the April Board meeting, a revised budget was approved for the balance of 
1949 which placed primary stress on economy, with the result that the deficit was 
reduced by $4,000. By mid-1949, both staff and office space of the Association 
had been halved. Through rigorous economies the Association succeeded in 
achieving two objectives: a substantial reduction of the deficit while maintain- 
ing basic services to the membership at minimum cost. 

In order to bring the budget into balance the following specific steps were 
taken: (a) transfer of the editorial and production work for the Journal and Bio- 
metrics, formerly the responsibility of the Washington office, to the technical 
editors of these publications. The latter were able to take advantage of the serv- 
ices of graduate students as editorial assistants. The Association provided a par- 
tial subsidy toward the cost of clerical work. (b) Reduction of the American 
Statistician in size and elimination of one issue. (c) Increase of membership sub- 
scription rates and associate membership dues in the Biometrics Section to begir 
with 1950. 

The Business Office of Biometrics was transferred to the supervision of Pro- 
fessor Gertrude M. Cox at the University of North Carolina. Funds received by 
the national office, in payment for Biometrics, were allocated to Biometrics, to- 
gether with a $750 grant from the Association. Looking toward the future devel- 
opments of the field of Biometrics, the Board has recommended to the Council 
that Biometrics be transferred to the Biometric Society under conditions mu- 
tually acceptable to the ASA and the Biometric Society. 

During 1949, Professor Wm. G. Cochran notified the Board of his desire to 
retire from the editorship of the Journal. In addition, Professor Oscar K. Buros 
tendered his resignation as Review Editor. President Kuznets appointed Sam- 
uel 8. Wilks, Dorothy 8. Brady, and Lester S. Kellogg to make recommendations 
as to editorial policy and personnel for the Journal. As a result of their recom- 
mendations it is anticipated that a new editor will be presented for the approval 
of the Council early in 1950. 

Following the resignation of Merrill M. Flood in May, Samuel Weiss, Chief of 
the Division of Employment Statistics, Bureau of Labor Statistics, Department 
of Labor, was elected Secretary-Treasurer of the Association by the Council. 

After one year’s experience with the new constitution, the Board found that 
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some of its provisions make it difficult for the Association to operate. During the 
coming year appropriate recommendations will be submitted to the Council and 


membership for consideration. 
Simon Kuznets, President 
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| mem- W. L. Tuorp 
L. L. THuRSTONE 
on be- 8. S. WiLks 
reased SamvuEL Weiss, Secretary-Treasurer 
k 
nee of During 1949, arrangements for the annual meeting program were, for the first : 
it was time in many years, handled outside the national office. The Board expresses its ‘ 
iation appreciation to the 1949 Annual Meeting Program Committee and the local 3 
led in New York arrangements committee for their work in forward planning and ef- 4 
ntain- ficient administration. 
: were Actions Taken by the Council During 1949 
d Bio- . The Budget of March 4, 1949 was approved. Vote: 11 For, 3 Against. 
hnical 2. It was voted to approve the recommendation by the Board of Directors that 
? BErv- work on publishing the Association’s periodicals be transferred from the na- 
dail tional office to be done on a volunteer basis when this is feasible and desirable 
erican from a budgetary standpoint. Vote: 12 For, 1 Against. 
p sub- . It was voted that the Board be directed to make recommendations to the 
begin Council concerning possibilities for transferring ownership of Biometrics to 
another organization. Vote: 13 For, 1 Against. 
 Pro- . It was voted that 
ed by A. The Council shall take action by mail ballot between meetings on mat- 
38, to- ters presented by the Secretary-Treasurer. 
level- B. Action under a mail ballot of the Council shall require that a majority 
puncil of the total number of members be in agreement. 
; mu- C. Each matter presented to the Council by mail for vote shall be con- 
. sidered as a motion by a member of the Council, whose name, except- 
ire to ing the Secretary-Treasurer, shall be listed at the end of the item. 
Buros Vote: 15 For. 
Sam- . It was voted that the ASA seek affiliation with the International Statistical 
tions Institute, as recommended by the Board. Vote: 15 For. 
com- . It was voted that the ASA decline the invitation to membership in the Na- 
roval tional Management Council. Vote: 15 For, 1 Against. 
. It was voted that the ASA decline the invitation to membership received 
ief of from the Societa Italiana de Demographia e Statistica. Vote: 14 For, 


ment 1 Against. 
1. . It was voted that the Council establish a Standing Committee on Relation- 
that tionships with other Technical Societies. Vote: 15 For. 
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9. It was voted that action on the request of the Eastern North American 
Region of the Biometric Society for affiliation be postponed, as recommended 
by the Board, until such time as the relationship between the two organiza- 
tions has developed to the point where there is a clear need and a tried basis 
for formal affiliation. Vote: 13 For, 1 Against. 

. It was voted that it be the policy of the ASA to join in the annual meetings 
of the Allied Social Science Associations each three years, beginning in 1949, 
alternating between New York City and Chicago. Vote: 15 For, 1 Against. 

. It was voted to establish a project for a statistician’s handbook subject only 
to the development by the Board of a suitable method for financing the ven- 
ture, and that the Secretary-Treasurer be authorized to contract for the 
ASA with such persons as may be necessary for the prosecution of the project 
in accordance with the approved budget. Vote: 12 For, 4 Against. 

. It was voted that it be the policy of the ASA to conduct clinics, or other such 
special meetings, either for the purpose of obtaining revenue or for the ad- 
vancement of statistics—provided always that the meetings contribute to the 
constitutional objects of the ASA. 

. It was voted that the ASA endeavor to establish and operate an effective 
placement service for its members, in cooperation with other appropriate 
organizations, as rapidly as possible. Vote: 13 For, 2 Against. 

. It was voted that it shall not be the policy of the ASA to endeavor to accept 
the traditional responsibilities of a professional organization, including 
classification and certification of membership, and as an inclusive statistical 
association concerned with the advancement of statistics in all fields of 
science, business, education, government, and affairs. Vote: 11 For, 5 
Against. 

. It was voted that the ASA approve the request of the Harrisburg Statistical 
Society that it be permitted to relinquish its ASA charter. 

. It was voted that the Council appoint a new Secretary-Treasurer in accord- 
ance with the following vote: 15 for Samuel Weiss. 

. The Council voted to send a letter to Dr. Merrill M. Flood expressing regret 
at his resignation as Secretary-Treasurer. 

. It was voted to authorize the 1950 budget submitted by the Board of 
Directors at the December 29, 1949 meeting of the Council. 

. The Council voted to appoint Holbrook Working as ASA representative to 
the Social Science Research Council. 

. A. It was voted to authorize the publication of a membership directory for 
distribution in 1950. The Council instructed the Secretary-Treasurer to 
seek to reduce the cost of such a publication by the use of less expensive 
processes of reproduction, such as offset printing. 

B. It was voted to amortize the cost of publication of the Directory over 
three years. 

. It was voted to recommend to the Board of Directors that all operating sur- 
plus in 1950 be applied first toward the wiping out of the remaining deficit 
of the Association before the expansion of any activities of the Association. 
It was, however, agreed that this be interpreted as a recommendation to the 
Board and not as a firm instruction. 

. It was voted to elect Aryness Joy Wickens and Hugo Muench for the 1950- 
52 terms on the Committee on Committees. 
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sn 23. It was voted to approve the recommendation of a sub-committee of the 
onion, Committee on Committees for the Guidance of the Committee on Fellows 
1 basic and to transmit this recommendation to the 1950 members of the Committee 
on Fellows. 
etings . It was voted to approve the recommendation that the standing committee on 
1949 occupational classification continue to be sponsored by the ASA and the 
sainet division of statistical standards during 1950. It was agreed that after the con- 
t pe clusion of the committee’s work on the 1950 census and the International 
cn. Labor Office classification, that the Committee would no longer be spon- 
be the sored by the ASA but would be left to the sole sponsorship of the division of 
roject statistical standards. It was voted that the ASA would give consideration to 
the re-establishment of a Committee on Occupational Classification around 
~— 1958, in preparation for the 1960 census. 
eyry . Upon recommendation of the Committee on Committees, it was voted to 
to the establish as a permanent section of the Association the Section on the 
Training of Statisticians. 
settee . It was voted to establish as a permanent section of the American Statistical 
priate Association a Section on Business and Economic Statistics. 
. It was voted to approve the following resolution concerning membership and 
ecept subscription rates: ioe ; a 
ndleg Ww HEREAS the By-Laws to the Constitution of the American Statistical 
stical Association provide under Article I, Section 4 dongs 
ds of “M embership Dues Exemption, that the Board of Directors may, at its dis- 
i 5 cretion, adjust the annual dues of a member of the Association or a class of 
y members for such a period as it designates. ” 
ated and WHEREAS Article II, Section 1 of the By-Laws provides under 
“Dues and Subscriptions, that the Board shall have the responsibility of 
_" drawing up the schedule of membership dues and subscription rates. This 
schedule may provide for a special rate to persons who hold membership in 
—_ more than one society, to husband and wife in case they agree to receive a 
single copy of publications and notices, and to younger members for a 
d of limited number of years. When the Council has approved the Board’s 
recommendation, the new schedule shall be announced in the news bulletin 
and shall become effective at the beginning of the next calendar year un- 
ve to less, within a period of four weeks after the mailing of the news bulletin, 
there shall be demanded a referendum as provided in Article VI, Section 5 
y for of the Constitution.” 
r to Therefore be it RESOLVED that this Board recommend to the Council 
sive that the following schedule of annual dues and subscriptions shall prevail 
beginning with January 1, 1950 and continuing until such time as the 
owe schedule may be revised: 


Dues 


sur- 
ficit Regular members 


ion. Sponsoring members 

the Student members 
(For a period of 4 years) 

50- Family membership 
(an additional $2.00 for husband and wife receiving 
only one copy of the periodicals) 





28. 


29. 


3n. 


31. 


32. 
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Introductory dues for persons under 30 $ 4.00 
(for the first year only) 
Associate members of the Biometrics Section 4.00 
Life membership as voted on October 7, 1948 
i.e., 25 to 30 years at joining 200 .00 
Over 30 at age A 290 .00—3A 
Subscriptions 
Journal 
Regular subscription to non-members 8.00 
Allocation of members’ dues 5.00 
Rate to members of associated or affiliated societies 5.00 
Biometrics 
ASA members 3.00 
The American Statistician 1.50 


WHEREAS Article II, Section 1 provides that the approved schedule of 
dues be published in the news bulletin of the Association, therefore be it 
RESOLVED that this schedule, after its approval by the Council, be pub- 
lished in The American Statistician for February, 1950 and be carried in the 
future as a regular part of the information concerning the Association in the 
Journal of the American Statistical Association. 

It was voted that the Board of Directors should appoint Samuel S. Wilks 
and Ralph J. Watkins as a Committee to complete the negotiation of a con- 
tract with James Boyd of the Bureau of Mines for the services of the Associ- 
ation in appraising the Bureau of Mines statistical program. 

It was voted to empower Lowell J. Reed and Harold Dorn, newly elected 
Chairman of the Biometrics Section, to act as negotiators with Gertrude M. 
Cox, Editor of Biometrics, and the Biometric Society concerning the transfer 
of Biometrics to the Society and concerning the future relationship of the 
Biometric Society of the ASA. 

It was voted to recommend to the Biometrics Section Committee that it 
reconsider the scope of interest of the Biometrics Section and prepare a re- 
port concerning the possible revision of its objectives. 

It was voted to establish the Biometrics Section as a permanent Section of 
the ASA. 

It was voted to elect the following representatives to other societies: 

Council of the American Association for the Advancement of Science— 
Frank Lorimer 

Inter-American Statistical Institute—T. N. E. Greville 

Joint Committee for the Development of Statistical Application in Engi- 
neering and Manufacturing—Paul Olmstead 

International Statistical Institute—Samuel Weiss 

Inter-Society Committee on Science Foundation Legislation—Frederick 
Mosteller 

American Documentation Institute—Donald Riley 

Advisory Board of the American Yearbook—Irving Lorge 

American Standards Association—Graphic Presentation—Kenneth Haemer 
American Standards Association—Office Procedure—W. Edwards Deming 
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It was voted to empower the President to appoint a representative to the Z16 
Accident Statistics Section of the American Standards Association. 
It was voted to elect Faith Williams as official representative of the Ameri- 
can Statistical Association to the Inter American Statistical Congress being 
held at Bogota, Colombia, January 16 through 28. 

33. It was voted to approve of holding the Annual Meetings of the Association 
as follows: 


1950 Chicago 
1951 Boston 
1952 Chicago 


34. It was voted to appoint a Publications Committee consisting of the three edi- 
tors of the three publications and one additional nominee from the staff of 
each publication. The President was authorized to name the Chairman of 
the Committee on Publications after polling the six committee members 
concerning their wishes. 

35. It was voted to authorize the President to proceed to the appointment of a 
Committee on the Constitution. 

36. It was voted to authorize the President to appoint a Committee on Corporate 
Membership. 

37. It was voted to authorize the Secretary-Treasurer to move the offices of the 
Association to air conditioned quarters at 1108 16th Street, N.W., Washing- 
ton, D. C., which are available at a nominal increase over the present rent 
paid by the ASA. 

38. It was voted to elect W. Allen Wallis as Editor of the Journal. 


Committee Activities 


The Association committees worked actively during the year. In particular, the 
Census Advisory Committee (Wm. F. Ogburn, Chairman), provided valuable 
assistance to the Director of the Census in planning for the 1950 Census. 

During the year the Committee on Committees, under the chairmanship of 
Aryness Joy Wickens, considered general principles governing committee ap- 
pointment, committee structure of the Association, need for advisory committees 
to governmental bureaus, standards for selection of Fellows, structure and nature 
of sections, and functions of the Commission on Statistical Standards and Or- 
ganization. 

The Section on Training of Statisticians (J. E. Morton, Chairman) answered 
queries from academic, business, and government sources concerning statistical 
pedagogy, and assisted in organizing several sessions of the Annual Meeting. The 
Business Statistics Section under Ralph J. Watkins was active in shaping por- 
tions of the Annual Meeting program. 

An Economic Statistics Section is in process of organization and, if sufficient 
membership support develops, will operate during 1950. Chapter officers and 
Association Fellows were polled by mail ballot and they elected a slate of interim 
officers of the Section. Formal reports from all active committees and sections 
will be published with the Proceedings. 

The matter of Eastern North American Region of the Biometric Society af- 
filiation with the Association is now under consideration by the Council. The 
Association affiliated with the International Statistical Institute during the year. 
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Forty-seven Association members attended the ISI annual meeting at Berne, 
Switzerland in September. 

Now that the financial difficulties of the Association have been weathered, 
cautious and balanced program of expansion appears in order. In view of the 
growth of statistical science and its steadily increasing role in the affairs of society 
a more venturesome program may be anticipated during the coming year. 


Reports of the Secretary and Treasurer 


The Secretary-Treasurer, Samuel Weiss, gave the official reports of the Secre- 
tary and Treasurer. 

During 1949 the American Statistical Association again began to grow and 
increased its membership by 225 members, bringing the total on its roll to 4,324 
by the end of the year. Although 339 members were dropped at the end of the 
year for non-payment of dues, 119 members resigned during the year, the 683 
new members who joined during the period October 1, 1948 through September 
30, 1949, more than offset these membership losses. 

The 1949 membership is composed of the following groups: 


Honorary members 
Regular members 


Total membership 
Corporate members........... 


The members of the Biometrics Section, at the end of December 1949 numbered 
872, of whom 145 are associate members and 727 are also regular members of the 
Association. 

The 1949 budget, as revised at the April 1949 meeting of the Board of Direc- 
tors, provided for an income of $48,300 and expenses of $46,463. Actual income 
for the year was $46,780 and expenses were $42,083. 

Income was less than the budgeted amount primarily because the estimate of 
new members expected to join the Association was too optimistic. There was no 
active drive for new members during the year and revenue from membership 
dues was approximately $1,650 short of the budget estimate. Journal sales were 
also less than the original estimates by some $600. 

As the result of a determined economy drive, expenses for the year were pared 
sufficiently to bring about a saving of some $3,850 over the already reduced 
budgeted amounts. A few of the items on which these savings were realized were: 
office salaries, $1,200; supplies, $1,100; Journal printing costs, $700; and mis- 
cellaneous expenses, $700. 

The net income for 1949 was $4,696 as compared to net losses for 1948 and 1947 
of $13,285 and $5,120, respectively. 


Report of the Committee on Elections 


Samuel 8S. Wilks, President-Elect during 1949, reported as Chairman of the 
Committee on Elections that the Secretary’s office had tallied the ballots of the 
membership, and that the following officers were elected: 
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President-Elect Lowell J. Reed 

Vice President, 1950 Philip M. Hauser 

Directors, 1950-52 Gertrude M. Cox 
W. Edwards Deming 


District Representatives to the Council, 1950-51 


Charles M. Armstrong, Northeastern District 
Howard L. Jones, North Central District 
Thomas J. Mills, Southeastern District 

Paul R. Rider, South Central District 

Eliot J. Swan, Western District 

John W. Tukey, Eastern District 


Simon Kuznets, retiring President of the Association, then turned the chair 
over to Samuel S. Wilks, Association President for the year 1950. 


Resolutions 


Harry Venneman presented the following resolutions for the Resolutions Com- 
mittee, both of which were voted unanimously: 

RESOLVED: That the officers and members of the American Statistical Asso- 
ciation express their profound appreciation to the Local Arrangements Commit- 
tee, and in particular to the Chairman of the Committee, Frank A. de Hermida, 
for their outstanding work in connection with arrangements for the 109th Annual 
Meeting. 

Whereas, by invitation of the Government of Colombia, and in compliance 
with action taken at the First Session of the Inter-American Statistical Institute, 
the Second Inter-American Statistical Congress will be held in Bogota, Colombia, 
January 16-28, 1950; and 

Whereas, the officers and members of the American Statistical Association 
have a lasting and sympathetic interest in the work of the Inter-American Sta- 
tistical Institute and a deep appreciation of the contributions of the Institute to 
the development of statistics in the countries of the western hemisphere: It is 
hereby 

RESOLVED: That the American Statistical Association felicitates the Inter- 
American Statistical Institute upon the occasion of the convening of the Second 
Inter-American Statistical Congress, and conveys to the Institute the good 
wishes of the Association for the success of the Congress; and be it further 

RESOLVED: That the Secretary-Treasurer be authorized and directed to 
transmit a copy of this resolution to the Secretary-General of the Inter-American 
Statistical Institute. 


Report of the Committee on Committees 


Aryness Joy Wickens, Chairman of the Committee on Committees, summa- 
rized briefly the first report of the Committee on Committees, which was printed 
in the December 1949 issue of The American Statistician. She read the following 
recommendations of the Committee concerning the functioning of the Commit- 
tee on Statistical Standards and Organization: 

The attached proposed charter (Exhibit 1) is a modification of that originally 
submitted by the Commission. This proposal was agreed to by Mr. Lubin and 





280 AMERICAN STATISTICAL ASSOCIATION JOURNAL, JUNE 1950 


approved with one reservation by the Committee on Committees. Some doubt 
has been expressed by the members of the Committee whether this idea is work- 
able without staff, which is not now available to the Commission. This revised 
charter has not yet been circulated to the Commission on Standards. The wording 
will undoubtedly have to be reviewed in greater detail. 

Among the questions which the Board should consider are: 

1. Should the functions of this Commission be limited to controversial ques- 
tions, reserving to special technical and policy advisory committees the review 
of proposed programs of governmental and other agencies requested by those 
agencies, as now provided in this report? 

2. Does the Board of Directors agree with the proposal to pass upon the oc- 
casions upon which the Commission may act on its own motion? 


Exhibit 1 


Proposed Revision of the Charter for the Commission on Statistical Standards 
and Organization 

The primary purpose of the Commission on Statistical Standards and Organiza- 
tion shall be to further higher standards in statistics. 

The Commission should have rotating membership based on a 6-year term; 
one-third of the initial membership to be appointed for 2 years, one-third for 4 
years, and one-third for 6 years. Election should be made by the Board of Direc- 
tors after consultation with the Commission. Jt shall have the right to appoint ad hoc 
subcommittees of specialists to carry out its projects. 

The functions of the Commission should be: 

A. To provide a tribunal to render opinions and recommendations on contro- 
versial issues relating to standards employed in statistical procedures and presen- 
tation of statistical material. 

B. To develop a list of minimum standards for published statistical materials. 

C. The Commission may undertake to review controversial questions relative to 
statistical validity or proficiency, when asked for advice or a report on such 
questions by governmental or other research bodies, or a group of interested 
citizens. 

When requested by a government agency, a recognized research body, or a 
group of interested citizens, it may review proposed undertakings and make 
recommendations relative to standards. 

The Commission shall not, as a rule, undertake any new project without approval 
of the Council except in emergencies, when the Board of Directors may pass upon 
the project. It may undertake investigations of projects of statistical standards only 
in those instances where the public interest, domestic or international, is concerned. 
It shall consider the advisability of investigating such matters with a view to pointing 
out to the public such inadequacies of technique and presentation as it may find. 

D. The Commission should eventually develop a code of ethical practices in 
statistical work. 

NOTE: Underscored material represents changes from the original charter 
approved at the annual business meeting of the Association on January 25, 1947. 

Committee on Relations with Other Technical Societies. This Committee was pro- 
posed by a vote of the Council. It is the view of the Committee on Committees 
that this should be a standing committee of the Council and that the nature of 
its duties should be determined by the Council. It seems likely that the questions 
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which will come before such a committee will relate to finances, publications, 
ways and means to secure affiliation, etc., and are, therefore, matters which can 
best be dealt with within the Council, with a report on behalf of the whole Coun- 
cil to the membership. 

Reporting to the membership concerning the standards for the election of 
Fellows, which were referred to the Committee on Committees by the annual 
business meeting at Cleveland, Mrs. Wickens reported that her Committee had 
arrived at the following recommendations: The Committee on Committees rec- 
ommends that the following standards be used by the Committee on Fellows in 
interpreting the constitutional provision that fellows shall be “statisticians of es- 
tablished reputation”: 

In order for a person to be considered a statistician in the sense of Par. 2 of 
Article 3 of the Constitution, it is necessary that he have contributed to the ob- 
jectives of the Association either through the application of his knowledge of 
statistical methodology or principles to some subject-matter field or through 
contributions to statistical methodology itself. Due consideration shall be given 
to outstanding teaching and administration of statistics, to the development of 
statistical methods, and to their adaptations to various subject-matter fields. 

It is suggested for the guidance of the Committee on Fellows that a statisti- 
cian’s reputation may be established by accomplishments in various fields, includ- 
ing in addition to original individual contributions, cooperation in publication of 
statistical periodicals or in planning and prosecution of major statistical projects, 
and creative training of statisticians. 

W. A. SHEWHART 


Report of Subcommittee on Association Sections 


Robert W. Burgess presented the following report of the Subcommittee of the 
Committee on Committees, which had considered the subject of Association sec- 
tions: 

In view of the wide diversity of subject matter in which members are inter- 
ested, and in the type of thinking among members of the Association, organiza- 
tion of sections is desirable both to meet the needs of members and to facilitate 
the advancement of knowledge in various areas. In order to be most effective for 
both purposes, procedures for establishing and maintaining sections should be 
flexible and varied. 

Sections may be initiated either by a group of members with a common statis- 
tical interest, or by the President or the Council of the Association if it is be- 
lieved that some significant field needs to be developed and can be developed by 
inauguration of a section. Sections may be established with the expectation that 
they will be continued indefinitely, or with the intention of dealing with some 
temporary problem and then dissolving. It is expected that sections will be 
started, dissolved, merged, or changed in scope and point of view in conformity 
with statistical developments. It is not thought desirable at present to limit the 
number of sections with which a member may be affiliated. 

Minimum necessary regularization should be secured by the following pro- 
cedures: 

1. Procedure for Creation of Additional Sections. 

New sections should be initiated provisionally by the President of the Associa- 
tion either on the basis of such suggestions as he may consider convincing or on 
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the basis of a section initiation proposal signed by a group of 25 or more mem- 
bers. After such provisional initiation and appointment of provisional officers, 
the formation of a section should be approved or disapproved successively by the 
Committee on Committees and the Council. Establishment on a permanent basis 
would follow preparation and acceptance of a statement of Scope and Point of 
View, and Election of Permanent Officers. 

2. Preparation and Adoption of Statement on Scope and Point of View. Before 
a section is considered as established on a permanent basis, a statement of scope 
and point of view should be prepared by the Section Committee with the ap- 
proval of the Committee on Committees. Particular attention will, of course, be 
desirable to avoid conflicts and possible competition with sections previously 
established. 

3. Selection of Officers. 

(a) Provisional officers should be appointed by the President of the Association, 
guided by such informal nominations or balloting as may have been carried 
through by those interested. 

(b) After the first year, principal officers (Chairman, Vice-Chairman, Secre- 
tary, and such officers as the section may prefer) should be appointed by the 
President of the Association, confirming selection by such procedure as the Sec- 
tion may prefer, such as voice vote at an annual business meeting, nomination 
by an appointed committee of the section, or voting of section members by ballot. 
The President of the Association would be expected to satisfy himself that these 
officers were in fact acceptable to the Scction and represented the important 
groups and interests within the Section. 

(c) Additional members of the Section Committee other than the Chairman, 
Vice-Chairman, and Secretary would be selected by the Chairman, with the ap- 
proval of the President of the Association. 

Responsibilities other than those in connection with the annual program should 
be as follows: 

(a) To make recommendations on publications in its field, and to try to stimu- 
late production of articles of types and on subjects not being prepared without 
such stimulation where it is felt that there are real statistical needs not being 
covered. 

(b) The Committee would also develop and maintain lists of Association mem- 
bers interested in sub-fields within its general field. 

(c) The National Section Committee would cooperate with Districts and 
Chapters in arrangement of local meetings on subjects within its field. 

Commenting from the floor, John W. Tukey asked whether the Committee 
on Committees had intended to preclude recommendations from section mem- 
bers concerning the members who made up the section committee. Mr. Burgess 
replied that this was not the intention of the Committee on Committees, and that 
his Committee was concerned that the greatest possible leeway be allowed section 
members in the methods used to elect or appoint their representatives. Ralph 
Watkins rose to state that he felt that the greatest contributions that sections 
could make to the Association was in the preparation of Annual Meeting sessions 
and in the preparation of Journal and American Statistician articles. He warned 
that allowing sections greater independence is a danger to ASA organization, 
which would probably lead to additional fragmentation. 

Eugene Pike pointed out that the large number of offshoots of the physicists’ 
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organizations should be taken as a warning to the Association, and suggested 
that ASA sections be asked to present regular reports concerning the objectives 
of their sections, so that these could be kept in accord with the purposes of the 
Association as a whole. 

Holbrook Working reported to the business meeting that a small group of 
interim officers of an economic statistics committee had met to discuss the posi- 
tion of the economic statisticians within the statistical association. He stated that 
the economic statisticians had a particular problem, in that they have no specific 
publication which responded to the specialized interests of the group. The Ameri- 
can Economic Association was in his view an organization of a different character, 
so that in the past the economic statisticians have looked to the ASA to take care 
of their substantive interests. 

Dr. Working, in summarizing the questionnaire distributed by him to the Fel- 
lows and officers of the Association, reported that the answers were as follows: 


SUMMARY OF OPINIONS EXPRESSED BY FELLOWS AND CHAPTER OFFICERS 
(Replies as of Nov. 2, 1949 to questionnaire mailed in mid-August) 


Number of Fellows and Chapter Officers questioned 
Number of replies 
Favored establishing Economics Section 
Would affiliate with Economics Section 
Economics would be primary affiliation 
Business Statistics would be primary affiliation 
Some other section desired for primary affiliation 
Designated no desired primary affiliation 
Number of replies regarding relations of Economics and Business Statis- 


Favoring combination in one section 
Favoring separation 
Uncertain 
Favoring election of Section Officers by Section members 
Indifferent to question 
Opposed to election of Section Officers 
Favoring election by all Section Affiliates 


Total indications of opinion regarding election.................-+-- 


® 83 replies were received by Sept. 26 in response to initial mailing; 11 replies were in response to a 
follow-up inquiry. 

> Including one professional economist whose expressed wish wes to affiliate with a section which 
would cover economics and business and other social science fields as well. 

© Four persons who indicated desire to affiliate with an economics Section but who expressed no 
opinion on election of Section officers are counted as indicating indifference. 


Provisional officers, nominated and elected by preferential ballot of Fellows 
and chapter officers, are: Robert W. Burgess, Morris A. Copeland, Frederick C. 
Mills, Aryness Joy Wickens, Holbrook Working, Chairman. 

President Wilks then asked whether there was any new business to be pre- 
sented to the meeting, and finding that none was presented the meeting was ad- 
journed. 
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Report of the Auditors 
To the Board of Directors of 
American Statistical Association 


We have examined the attached financial statements of American Statistical 
Association relating to the year ended December 31, 1949. Our examination was 
made in accordance with generally accepted auditing standards, and accordingly 
included such tests of the accounting records and such other auditing procedures 
as we considered necessary in the circumstances. 

The recorded cash receipts for the year were traced to the deposits shown on 
the bank statements and the amounts for dues and subscriptions were tested 
with the membership and subscription records. The paid checks were inspected 
and related vouchers tested in support of cash disbursements for the year. The 
bank balances were reconciled with amounts reported direct to us by the deposi- 
taries and the cash on hand and the securities owned at December 31, 1949 were 
verified by inspection. We did not check the membership and subscription ree- 
ords in detail or make any independent verification of the inventory of old Jour- 
nals, the office records of which are based, in part, on data assembled in prior 
years, no recent physical inventory having been taken. 

The life membership reserve at December 31, 1949 reflects the amount needed 
to support a life annuity for each life member in the same annual amount as that 
which could have been purchased by the original lump sum payment, based ona 
2} % interest rate, the 1937 Standard Annuity Table and the age of the life men- 
ber when the lump sum payment was made, in accordance with a resolution of 
the Board of Directors adopted pursuant to a mail ballot in January 1949. The 
amount treated as income from life memberships in 1949 represents the excess of 
the reserve at the beginning of the year over the required reserve at the end of the 
year. 

In the accounts for the year 1948 provision was made to cover employees’ ac- 
crued annual leave for that and the preceding year. Such provision was made 
at the direction of the then Secretary of the Association. This practice has now 
been discontinued and the unused portion ($253.32) of the reserve has been 
closed out through the 1949 income statement. 

In our opinion, the accompanying statements present fairly the position of 
American Statistical Association at December 31, 1949 and the results of its 
operations for the year, in conformity with generally accepted accounting prin- 
ciples applied on a basis consistent, except as mentioned in the preceding para- 
graph, with that of the preceding year. 

Price, WATERHOUSE & Co. 
Washington, D. C. 
May 1, 1950 
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AMERICAN STATISTICAL ASSOCIATION 
BALANCE SHEET 


December $1, 
Assets 1949 1948 


Cash in banks and on hand $10,233.31 $ 7,513.00 
Accounts receivable 1,204.97 
Investments: 
United States Savings Bonds, Series D, at re- 
deption value 3,920.00 6,406 .00 
Stocks, at cost 5,793.50 
Inventory of old Journals, at approximate cost.... 1,902.26 1,907.51 
Furniture and equipment, at cost less depreciation 2,463 .22 2,892.19 
Deferred charges 628.00 277.80 


$20,867.89 $25,994.97 











Liabilities 

Accounts payable $ 3,499.74 $ 4,631.43 
Note payable 5,000 .00 
Accrued interest 37 .50 
Accrued annual leave 1,209.54 

Deferred income (collections applicable to subse- 

quent year): 
$13,431.25 $15,964.53 
3,897.57 3,797.59 
53.10 

$17,381.92 $19,762.12 


Life membership reserve $ 3,066.62 $ 3,131.40 
Deficit account, per statement (3,080.39) (7,777.02) 


$20 ,867.89 $25,994.97 

















AMERICAN STATISTICAL ASSOCATION 
STATEMENT OF INCOMB AND DeEricit ACCOUNTS 


Year ending December 31, 
1949 1948 


Income: 

Dues—current year $32,366.93 $ 32,495.90 
Dues—prior years 54.65 
Life membership income 64.78 418.80 
Subscriptions 8,576.69 7,386.28 
Advertising 1,311.80 1,728.77 
Reprints 892.09 
Journal sales 2,841.52 2,702.19 
Biometrics Section income 4,212.70 
Dividends and interest 549.40 704.50 
Gain on sale of securities 219.96 

Miscellaneous 849 .26 724.15 


$46,780.34 $ 51,320.03 
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Expenses: 

Journal—printing, mailing and reprints $10,702.77 $ 12,160.70 

Salaries and wages less in 1949 $253.32 accrued 
annual leave expense applicable to prior year 18,637.81 30 , 582.81 
American Statistician Bulletin 3,716.53 5,875.55 
750 ,00 4,316.29 
2,617.50 2,880 .00 
1,335.65 1,599.27 
1,186.51 1,748.74 


618.70 754.81 
Travel expense—officers.................... 661.08 649 .20 


Annual meeting expense 613.31 
Depreciation of furniture and equipment 487 .36 442 .86 
Promotion expense 743 .28 
Storage of old JouRNALS 185.58 71.95 
Cost of old JouRNALS sold.................. 100.00 573.10 
Miscellaneous 1,084.22 1,593 .63 
$42,083.71 $ 64,605.50 
Excess or (deficiency) of income for the year. $ 4,696.63 $(13,285.47) 
Deficit account— 

At beginning of year (7,777 .02) 5,508.45 


At end of year $(3,080.39) $ (7,777.02) 




















BOOK REVIEWS 


(The review section for this issue has been edited by Ernest Rubin.) 


Balance of Payments Yearbook, 1938, 1946, 1947. International Monetary Fund. 
Washington, D.C., 1949. Pp. 383. Paper $4.00, Cloth $5.00. 


REVIEW BY MyrTLe BRICKMAN 


International Trade Economist, Office of International Trade 
U.S. Department of Commerce, Washington 25, D.C. 


— Fund has adopted a broad concept of the balance of payments which 
enhances its usefulness for purposes of economic analysis. In fact, the 
term “balance of payment” is misleading; the data presented in the yearbook 
cover all economic transactions between residents of a given country and 
the outside world, whether or not the transactions result in money transfers. 
This approach has the advantage of affording an unusually complete record 
of the actions which actually or potentially affect a country’s international 
financial position. 

A particularly useful concept which has been developed by the Fund, and 
which is prominently featured in the yearbook, is that of compensatory 
official financing. In essence it is a measure of the extent to which imbalance 
in other international transactions has forced a country’s monetary author- 
ities to take financial action. In order to bring out the distinction between 
what might be termed the “balance of ordinary transactions,” i.e., those 
carried out by private individuals, organizations and governments in pursuit 
of their own personal and/or commercial dealings with the outside world, and 
those transactions undertaken by monetary authorities to offset a surplus 
or deficit arising from the foregoing, the Fund has furnished, for each report- 
ing country, a statement showing the manner in which the international 
transactions were financed. 

In addition, the standard balance of payments statement, broken down 
into current and capital transactions categories, has been furnished for each 
of the 50 reporting countries. The standard statements and the statements 
of financin of international transactions are also furnished for Europe and 
for Latin America as economic regions. 

The yearbook is divided into two parts. In Part I are discussed refinements 
of definition and of classification which have been developed by the Fund’s 
technicians in order to bring out the basic significance and most meaningful 
relationships of the material presented. Statistical data for regions and 
individual countries, and discussions of the balance of payments character- 
istics peculiar to individual nations, are._presented in Part IT. 


287 
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The problem of standardizing balance of payments data on an interna- 
tional basis is extremely difficult. The yearbook indicates the nature of the 
difficulties and what the Fund has done to achieve statistical comparability, 
Workers in the field will find the volume doubly attractive; it contains a 
wealth of statistical data as well as important substantive material. In 
addition, it is clearly printed, the tables have been carefully annotated, and 
the text is lucid. 


Quality Control in Industry: Methods and Systems. John G. Rutherford. New 
York: Pitman Publishing Company, 1948. Pp. xvii, 201. $3.50. 


Review By W. R. Passt, Jr. 


Quality Control Division, Bureau of Ordnance 
Navy Department, Washington 25, D.C. 


TATISTICIANS who have introduced Statistical Quality Control methods in 
S a plant or organization with initial success have sometimes found them- 
selves quite unprepared for the consequential organizational adjustment. 
In these cases, Statistical Quality Control has remained a thing apart rather 
than becoming the nerve and communication center for a quality minded 
organization. John Rutherford has attempted to equip the statistician with 
some knowledge of organization and to equip the engineer with enough 
statistics to carry through the quality control job successfully. His book is 
divided into two parts (really two short books): the first eight chapters deal 
with organizational framework for quality control and the last six deal with 
the statistical formulas, theories and applications. 

Rutherford has recognized an important problem and has made an impor- 
tant contribution toward its solution. However, the first section, dealing with 
organization, leaves one more aware of the problems than one is helped with 
possible solutions. The statistician does not find the guide lines for making 
sure that his work will become an implicit part of the organization. Also, 
there is an absence of sharpness in concepts as shown in the discussion of the 
relation between a quality control department and an inspection department 
and in the discussion of the departmental responsibilities for screening 
inspection. For instance, such expressions as “on the old concept, inspection 
was rejection,” on Page 10, appéar incomplete. Part of this difficulty appears 
to arise from the absence of a clear distinction between “Quality Control” 
which has been used in industry for a long time, and “Statistical Quality 
Control” which required new ways of thinking. 

The last section of the book gives, for the most part, the statistical formulas 
necessary for application of control chart and sampling techniques. The 
examples scattered through the text are the most interesting part of these 
chapters. However, the looseness of expression and concept carries through 
in this part of the book, for instance, in the statement on Page 86 that “All 
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sampling methods are based on the parts being classed as good or bad.” 
Despite its limitations, this book can be expected to be the forerunner of 
many books designed to make the industrial engineer acquainted with the 
thinking of statistics applied in industry and the statistician acquainted 
with the consequences of his work. 


Length of Life, A Study of the Life Table, Revised Edition. Louis J. Dublin, 
Alfred J. Lotka and Mortimer Spiegelman (Metropolitan Life Insurance Com- 
pany). New York: The Ronald Press Company, (15E. 26th St.) 1949. Pp. xxv, 
379. $7.00. 


Review BY Haro.p F. Dorn 


Chief, Biometrics Branch, National Institute of Health, 
Bethesda, Md. 


\ ce is more than a revision of a book which has remained unrivaled dur- 
ing the thirteen years since its first publication; it is practically a new 
book. The material in the original edition has been largely rewritten and 
brought up to date. Two new chapters, “Biological Factors Influencing 
Longevity and Mortality” and “Forecasts of Mortality and Longevity” have 
been added. 

The eighteen tables in the appendix present what is probably the most ex- 
tensive collection of life table functions together with a reference to their 
source to be found in any single publication. Historical series of the complete 
expectation of life and the mortality rate at decennial ages by sex and color 
are shown for the entire United States, geographic regions and each state. 
Corresponding data by sex appear for each country in the world for which 
such information is available. Especially noteworthy is the long series for 
Sweden covering the period from 1755 to 1940. The series of tables concludes 
with excerpts from the principal life insurance and annuity tables. 

Taking as their central theme, the life table, the authors first sketch, in 
broad outline, the progress achieved in increasing the average length of life 
from prehistoric times to the present. Very roughly, this increase is nearly 
threefold. As the authors quite correctly point out this remarkable increase in 
average length of life does not imply a corresponding increase in the span of 
life or the biological limit of individual existence. 

Attention is then focused upon the gain in longevity in the United States 
in recent years and the unequal distribution of this gain among the forty- 
eight states. Accepting these data at their face value, under the mortality 
conditions prevailing around 1940, a white male infant born in Nebraska 
could expect to live nearly 10 years longer than one born in Arizona. 

Having presented a general picture of progress in increasing longevity the 
authors consider various factors which have made this increase possible. A 
brief scanning of chapter titles reveals the wide scope of materia! discussed, 
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biological aspects of the life table, the inheritance of longevity, biological 
factors influencing longevity and mortality, the contribution of medical and 
sanitary science to health and longevity, longevity and mortality in relation 
to physical condition and longevity and mortality in relation to occupation. 

A new chapter, forecasts of mortality and longevity, has been added in 
recognition of the increased interest in recent years in this topic by persons 
forecasting population changes and by those trying to estimate the effects of 
improved medical care. The subject of generation life tables is introduced 
and the calculation and meaning of such tables is contrasted with current 
life tables. 

The application of the life table to population problems, a subject which 
owes much to the work of Alfred J. Lotka, is illustrated in considerable de- 
tail. In view of the recent upsurge in the crude birth rate and its possible im- 
plications for the future growth of the population of the United States, 
the discussion of the net reproduction rate and its interpretation over time 
seems undesirably brief. Although some difficulties in the interpretation of 
the net reproduction rate are discussed briefly in a footnote this subject 
merits more attention than it received. 

The application of the life table itself or the general technique of life table 
analysis to economic problems is illustrated by the computation of various 
types of insurance premiums, the estimation of the money value of a man, 
compensation for risk and injury, depreciation of physical property and the 
legal aspects of mortality tables. A concise description of the evolution of 
insurance life tables and a mention of the more important tables completes 
this part of the book. 

The authors close the book with a chapter on life table construction which 
is one of the most clear, concise and practical discussions of this topic with 
which I am familiar. This chapter is much improved over the corresponding 
chapter of the first edition in the sense that it is more in keeping with the char- 
acter of the rest of the book. The discussion of this subject in the first edition 
was competently written but it seemed too complicated for the audience to 
which the rest of the book was directed. Greville’s method of abridged life 
table construction is described together with relatively simple procedures 
for interpolating values for individual years of life. The method is sufficiently 
rigorous for all except the most precise problems and yet is simple enough 
and involves just about the maximum amount of labor for practical purposes. 

The book is clear, concise and gives a working introduction to a wide 
variety of topics. It is extensively illustrated with seventy-six tables and 
thirty-two charts, most of which are models of statistical procedure. Stat- 
isticians, physicians, public health workers, actuaries, demographers and all 
who are interested in life itself will find this book not only a mine of knowl- 
edge and information but also a fertile source of new ideas. 
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Public Health Statistics, 2nd Ed. Rev. Marguerite F. Hall. New York: Paul B. 
Hoeber, Inc. 1949. Pp. xxvii, 441. $7.50. 


REVIEW BY JOHN W. FERTIG 


Professor of Biostatistics, School of Public Health, 
Columbia University, New York 


HE present edition of this book differs little from the first which appeared 
Tin 1942. The tabular material has largely been brought up to date, a new 
chapter has been added on some of the applications of life table techniques 
to public health problems, and a few minor additions have been made else- 
where. The general organization of the text is unchanged. Most of the inac- 
curacies and loose statements present in the first edition have not been cor- 
rected. 

The first fifteen chapters are devoted to the standard topics of vital sta- 
tistics such as tabular and graphic presentation, population data, collection 
of data on vital events, rates and ratios, trends, life tables. This section is 
followed by four chapters devoted to the conventional analyses of measure- 
ments in terms of constants of centering, variation, and correlation. There is 
a brief chapter on the theory of probability, and one on measures of reliabil- 
ity. 

The material included under the vital statistics topics is in general perti- 
nent but poorly organized and repetitious. Thus the life table is explained 
twice in some detail in Chapter VII and in Chapter XIV. Much of the ma- 
terial included in Chapter XXI on measures of reliability has already been 
discussed in an earlier chapter on rates. 

Many of the methods are presented in a rather rigid way as though there 
were just one way of doing it. This is particularly apparent perhaps in the 
chapters on tabulation and graphing where many different kinds of tables 
and graphs are presented to show current practices without a clear state- 
ment of principles of tabulation or graphing. In this connection there is a 
great deal of unnecessary naming of various tables, part of tables, etc. 

There are many false statements in the text. Examples are: Page 64: “The 
dependent variable is always represented on the base line or horizontal axis.” 
Page 73: “The histogram is an accurate graphic portrayal of the frequencies 
of things which vary continuously so long as the bases of the rectangles are 
equal; that is, so long as the groups are of equal width.” Page 181: the 
general death rate from all causes is called “crude death rate without cause.” 
Page 349: “In medical phraseology, the probability of a cure is p=}. The 
probability of the failure to cure is designated as g =}. In cure or failure to 
cure there are only two possible outcomes. The chances are even that the 
patient gets well or continues to be ill in that particular trial of medicine.” 
Page 372: “Since the obtained statistical constants are values about which 
other corresponding constants will vary—if calculated again on additional 
samples—it is necessary to attach to the obtained values the sampling error 
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formulas.” Page 389: “If chance alone is operating, then x? is zero, because 
the observed and theoretical frequencies will be the same.” 

A great deal of effort has undoubtedly been expended in the preparation 
of this book. Many sources of data have been used. It is unfortunate that the 
organization is so poor and that so many inaccurate statements should be 
present. 


Bureau of the Census Manual of Tabular Presentation: An Outline of Theory 
and Practice in the Presentation of Statistical Data in Tables for Publication. 
Bruce L. Jenkinson. Washington: Government Printing Office, 1949. Pp. xiv, 
266. $1.50. Superintendent of Documents, Washington 25, D.C. 


RevIEW BY Ray Ovip Hat 
Economist, 1763 Columbia Road, Washington, D. C. 


HE Bureau of the Census turns out tables, as all know, by assembly line 

methods. Its tabular product, even in nondecennial times, swamps utterly 
that of any rival on the planet in either volume or variety. That supremacy 
might almost be won by its annual Statistical Abstract alone. Its staff being 
the world’s most prolific designers and editors of tables, its own official man- 
ual of tabular presentation is high authority indeed—a must for all statistical 
libraries and nearly all statisticians. 

This large manual is most complete of all in its rich terminology. Even a 
veteran statistician looking through its fine index will be stumped by such 
typographical terms for table-parts as: bearoff, read-in, undercut spanner, 
panel, contracting brace, nonprime column, quasi-banner head, broad-divide 
table. There are illustrations of more structural-types of table than anyone 
can easily recall, each with a name. 

All these Census terms might well be accepted as authoritative, if only as 
a shortcut to uniform terminology. Thus, ‘column head’ supersedes ‘columnar 
caption’; and ‘column box’ is the space it goes into. ‘Column boxhead’ can 
have no meaning, for ‘boxhead’ is all the space between headnote and the 
top line of figures. 

There are four chapters on stubs, two on boxheads, and one on each of the 
following subjects, among others: table titles, table numbers, headnotes, 
footnotes, and fields. The chapter on titles runs to 27 pages, some 12,000 
words—a perspective to delight the heart. Table titles on the Washington 
scene commonly range downward from fair to atrocious. 

There is plenty to quibble about in any manual so detailed on subject- 
matter so elastic. Thus, p. 73, “No period should appear at the end of the 
headnote even though the last statement is a complete sentence.” That rule 
has long prevailed in the Statistical Abstract, but is it inspired? 

Again, p. 70, “Headnotes should be used when they are essential to under- 
standing, not otherwise.” For sounder guidance I still commend rather se- 
riously a quotation in my Handbook of Tabular Presentation, p. 5, “If it has 
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no scale of miles, it is no map; no date, no clipping; and no headnote, no 
statistical table.” There are exceptions but let each bear its own burden of 
roof. 

‘ Bad headnoting on the Washington scene is commoner even than bad ti- 
tling. Yet this manual carries only six pages on headnotes, with only three 
lines (p. 70) on the duty of table builders to warn table users against “limita- 
tions of data.” Worse, there is nothing at all on the need for long textual 
statements preceding most tabular series, to describe the reporting system 
and to inventory religiously its defects in planning, coverage, and reliability 
of returns. What reporting system ever was there with no defects? The mat- 
ter of frankly reporting them, in headnotes or general statements, is not one 
of tabular form; it is an ethical imperative. Scientific attitude permits no 
posturing over faulty or dubious results. 

Perhaps ten Federal agencies, more table-conscious than the rest, have 
their own pamphlet manuals on tabular presentation, with illustrative tables. 
Many of these supposedly model tables emerge from systematic scrutiny, 
amusingly enough, as anything but model. ‘Two were poor enough to be re- 
produced in my Handbook, pp. 101-102, with other inferior tables, as problems 
in tabular editing. How now are the model tables in this Census Manual? 
Following are thumbnail critiques of the four least satisfactory ones: 

P. 14, top: This tiny table of only 16 lines could be improved in nine 
ways, mostly important. All its figures pertain to “Consumption;” that term 
belongs hence in title or headnote, not in column heads. All figures are in 
cords; say this, not in column heads, but in parens above the top horizontal 
ruling. Stub needs arraying by magnitude. Put subtotals in italics. Put a 
space break (blank horizontal line) after the “hardwoods” group. Insert col- 
umn for Net Change. Put the 1944 column to the right of that for 1943. 
There is spurious accuracy in carrying these measurements to units; round- 
off to thousands, though still spurious probably. Addends do not equal sub- 
total for “hardwoods”—an arithmetical discrepancy. 

P. 17, top: Stub lists classes of public expenditure: array by magnitude. 
Pp. 18-19: Columns list lines of business; array. In the former, first column, 
another arithmetic error. 

Pp. 20-21: This long employment table lists alphabetically hundreds of 
industries—with absurd sequences like “belts, biscuits, and blast furnaces.” 
Stub should group related industries and provide for subtotals; fluctuations 
in subtotals could be highly enlightening. Insert a stub line for GRAND TOTAL. 
Group-spacing of stub, space breaks, at two points would improve horizontal 
legibility. 


Indispensable as this long manual is for reference, in the Census Bureau 
or wherever, it rates low as a teaching aid. Principles and purposes are mired 
in swamps of detail. The book is too long for use in a general course on sta- 
tistics, which can spare only a few lectures on tables. Good table building 
is best taught by working with bad tables, revising and revising. There is 
happily no shortage in these teaching aids; slapdab tables abound in the 
annual reports of most Federal agencies. 
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This tremendously laborious and highly useful treatise is edited unevenly, 
Most paragraphs are exemplary in their clarity and terseness, but the dear 
old bureaucratic gobbledygook is there, too—as on pp. ix and 67. Another 
defect is that much of the text is in print too small for easy reading. 


Experiment Design and Judgment of Evidence. Errett C. Albritton, M.D. (Profes- 
sor of Physiology, George Washington University School of Medicine, Washing- 
ton, D. C.) 1949. Pp. vi, 122. $2.75. (Lithoprinted by Edwards Brothers, Inc., 
Ann Arbor, Michigan). 


REVIEW BY MARGARET MERRELL 


Associate Professor of Biostatistics, School of Hygiene and Public 
Health, and Lecturer in Preventive Medicine, School of 
Medicine, The Johns Hopkins University, 

Baltimore, Md. 


On the last decade a considerable number of medical schools have 
added a short course in quantitative methods to the curriculum of the 
pre-clinical years. These courses vary greatly from one school to another 
depending upon the background of the person responsible for the course and 
his point of view as to the most important things to emphasize in the short 
time at his disposal. The present book represents Dr. Albritton’s answer to 
this teaching problem. It is directed to the training of the student as a future 
clinical investigator or as an intelligent reader of the reports from his col- 
leagues. 

The book is not a textbook in the usual sense, but is a combination ofa 
discussion on the logic of the scientific experiment and a condensed syllabus 
on statistical method. It is stated in a note to the reader that the book is 
being privately printed in small quantities and with frequent revisions, with 
the aim of making it sufficiently useful in the teaching of statistics to medical 
students, so that it will eventually be formally published. In the meantime 
the writer solicits criticism from the reader. 

The main subject of the book is the study of those special types of corre- 
lation where one variable (the agent) causes the other (the result). The me- 
chanical analogy of the ringing of the electric bell is carried over to the bio- 
logical field with stimuli producing responses. The weighing of the evidence 
in a controlled clinical experiment is visualized in terms of sitting in judgment 
as to the claims of three competitors in causing the result, namely, the agent, 
an associated agent, and chance. The experiment must be so set up and an- 
alyzed that these claims may be adjudicated and statistical analyses to aid 
in this assessment are presented. 

One may argue that any such judgments in biological material involve 
over-simplification. Nevertheless they are the kinds of judgment that the 
medical experimenter is continually required to make. The most effective 
part of the book is the lively discussion of the logic of clinical experimenta- 
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tion with medical illustrations to point up the issues involved in the exact 
conditions of measurement, the setting up of controls, the numerous factors 
behind any recorded number including the process of recording itself, the 
danger of bias (“the patient trusts the doctor, the doctor trusts his hypothe- 
sis, and both may overestimate his improvement”). Clinical experiments are 
difficult; many of them are badly conceived and there are often unwitting 
and elusive snares in their presentation. The medical student who has studied 
this book will be in a better position to read the Journal of the American 
Medical Association with discrimination. 

To be a satisfactory statistics textbook, considerable re-writing and am- 
plification are required. There are many errors, the exposition is frequently 
confused and there is less than a minimum of underlying concepts and as- 
sumptions outlined, even for a short course. The initial statement with re- 
gard to the contribution of statistical methods to experimental work places 
tests of significance in small samples as the principal contribution. These 
are, in the opinion of the reviewer, of minor importance compared with esti- 
mates derived from the data. Although in his illustrations the so-called “re- 
sult-statistics” or estimates are stressed, too little attention is given to the 
question of appropriate analysis of the data, and too much to tests of sig- 
nificance after estimates have been made. Similarly too little is made of bio- 
logical variation and too much of sampling variation. There is confusion in 
the term “extremeness” of a difference between the size of the difference and 
the significance of the difference. 

Since the book is not to be formally published in its present form, there is 
no point in listing errors here. However there is one fallacy that should be 
mentioned since it goes beyond the matter of significance tests. This appears 
in the final problem of the last chapter, which is devoted to an interesting 
collection of problems from the medical literature. The problem in question 
deals with a long-time post-treatment follow-up of patients. Survivorship 
tables are given for the years after treatment, but they represent actually a 
combination of survivorship and duration of observation. Significance tests 
are applied to these “survivorship” tables for different treatments, although 
the values are not comparable. The recent emphasis on chronic disease prob- 
lems has made this a frequently encountered problem and it is a rare medical 
paper that analyzes the material correctly. Although in the example. pre- 
sented the error is trivial, the method used frequently leads to results that 
are not of the same order of magnitude as the correct results. This deserves 
some real exposition in a book of this kind. 

Undoubtedly the errors in the book will be corrected with subsequent re- 
vision. It is to be hoped that in addition there will be considerable amplifica- 
tion in the exposition of statistical methodology. It is a stimulating and un- 
usual book, and with revision and extension, could be a very useful contribu- 
tion to the small supply of books on the quantitative approach to medical 
problems. 
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Applied Experimental Psychology. Alphonse Chapanis (Assistant Professor of 
Psychology, Johns Hopkins University), Wendell R. Garner (Director, Psycho- 
logical Laboratory Institute for Cooperative Research, Johns Hopkins Uni- 
versity), and Clifford T. Morgan (Professor of Psychology and Chairman of the 
Department, Johns Hopkins University). New York: Wiley and Sons, Inc., 
1949, Pp. xi, 434. $4.50. 


Review BY REUBEN L. REVENS 


Head, Special Reports Unit, Air Studies Division, 
Inbrary of Congress 


poe volume is concerned with a vital area of contemporary psychological 
research: the variety of problems treated in the fields dealing with the 
contributions of laboratory and research psychology generally to the design 
of machines and devices to be used by man, optimum conditions for the hu- 
man part of man-machine systems, and the like. Since very few texts and 
little periodical publication on the systematic techniques and principles exist, 
advanced texts are as badly needed as introductions to the subject. The pres- 
ent volume, based on a series of lectures given to engineers, seems almost 
entirely intended as an introduction at a distinctly elementary level. 

The introductory chapter as well as the preface is devoted to describing 
the field of investigation and practice variously known as human engineering, 
engineering psychology, psychotechnology, as well as by other names. The 
authors in stressing the recency of the entrance of psychologists into the field, 
because of the impetus of the late war, dismiss forty years that include 
Moede’s magnificent work in Germany that was underway before the first 
World War, Viteles’ rich years of research and all the rest, with “scientific 
studies were rather few in number.” It is explained that the text developed 
from a course given in 1947 at the Naval Postgraduate School, Annapolis, 
and the authors emphasize their intention of talking to the reader instead of 
writing to him; short words and simple sentences are to be used instead of 
complicated terminology and involved passages. The statistical chapters 
(2 and 3) “are concerned solely with problems of methodology because there 
are some new techniques that are helpful in handling experimental problems 
in this field, and they are not too well known.” 

It is unnecessary to stress in this Journal the incompatibility of verbal 
easiness with the intrinsic preciseness of mathematical and statistical con- 
cepts. Popularization, however worthy a principle, can be dangerous in 
fields that are specifically justified by the rigorousness of their logic and oper- 
ations. The statistical chapters are marked by haziness and looseness and 
despite the authors’ referrals to more complete works in statistics, would al- 
most inevitably leave the trusting reader with a number of particular mis- 
conceptions and a general confusion as to the actualities of statistical think- 
ing. 

Chapter 2 is entitled “A Little Statistics.” In the compass of 24 pages (with 
much of this space devoted to extensive tables of scores, long instances of 
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worked examples, histograms, and frequency curves) the authors undertake 
to introduce, as to a complete novice, the concepts of normal distribution and 
skewness; measures of central tendency (the mean and the median); meas- 
ures of dispersion (the range, the AD, the SD or a) [they caution that 
“Although quality control and other statisticians frequently refer to the 
standard deviation by its Greek name, sigma, the reader will realize that this 
can very easily be confused with the capital letter which means ‘the sum 
of’.”]; correlation; statistical inference (with discussion of population and 
sample), the standard error of the mean, and the use of correlation in pre- 
diction. 

In one worked example they explain such elementary matters as addition 
without regard to sign, and shortly after in another they crowd the reasoning 
that involves entering a class interval to obtain the median individual into 
the phrase “is computed by interpolation,” although no previous example 
of the median has been given. Moreover, this illustration takes the salary 
range of 132 professors, an even number, so that their statement that “the 
66th highest paid professor” divides the distribution in half, while defend- 
able by custom in working with grouped data, must confuse the reader 
thoughtful enough to make his own effort to find the median as they have 
correctly defined it. 

There is, it is true, frequent reference to the fact that they are giving only 
“an introduction to a statistical way of thinking.” But the elaborate working 
of some parts of examples makes more glaring the inconsistent gaps in the 
course of such step-by-step explanations. Thus, coded midpoints appear in 
two tables and are used in one example, but the instructions for obtaining 
coded midpoints are specific to the data in the worked example, and no gen- 
eral rule, or discussion of the reasoning in deriving coded midpoints is offered 
at any point. The descriptions of operations actually performed have a tend- 
ency to be most detailed when the operations are obvious, and most sketchy 
when the reasoning is difficult to follow. 

Chapter 3, “The Use of Statistics,” is devoted almost entirely to the dis- 
cussion of constant errors and variable errors, and their combined effect in 
man-machine systems. There are long explanations and illustrations of the 
differences between the two kinds of errors, and a number of practical exam- 
ples of how these two kinds of errors can be measured as well as their relative 
importance in the final accuracy of man-machine systems. (*. . . this looks 
like a very complicated formula, but it is really not so bad when you dissect 
it.”) Variance is the main statistic now, and again, although the language 
and explanations of elementary matters indicate that the material is ad- 
dressed to the statistical beginner, the gaps in the presentation, and the loose- 
ness of the definitions, would seriously handicap any reader dependent on 
the text alone for the assimilation of the concepts the authors assume they 
have adequately presented. 

The rest of the book, which the authors justifiably regard as the bulk of 
the work, has a grand variety of interesting surveys and discusses some very 
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lively fields of research in psychotechnology. Even professional psychologists 
will occasionally find useful and stimulating information in the details of 
developments in such fields as dial legibility, tonal signalling systems, con- 
trol design, and arrangement of work. The sections summarizing data on 
vision and hearing are generally adequate although there is a loss of clarity, 
as well as accuracy, when the attempt to be colloquial leads to such expres- 
sions as, “One way of describing the light which comes from an object is to 
show the relative amount of energy at the various wavelengths in the bundle 
of light.” 

There are many excellent figures illustrating the evolution of human en- 
gineering solutions to a variety of problems (including optimum seat length 
for males, females, and the general population). It is unfortunate that the 
laudable intention of avoiding the undesirable consequences of jargon-laden 
passages has often led the authors (even outside the statistical chapters) 
into a tone of condescension and talking-down that leaves the reader with a 
justified feeling that topic after topic has been superficially rather than 
fundamentally discussed. This is possibly due in part to their frequent de- 
pendence on secondary or second-rate sources. Thus (a random example) 
in the discussion of the effect of sleep-loss on fatigue and efficiency, they make 
no use of the exhaustive basic studies by Kleitman, nor refer to his classic 
1939 text, and from Johnson’s years of research and review they quote only 
a 1926 paper. 

In summary, a magnificent opportunity for an important contribution toa 
dynamic field has been largely mishandled. The merits of some sections, and 
the beautiful design and production, are outweighed by the trivial level and 
general looseness of much of the text. A revised edition, aimed at a group re- 
garded at least as sophisticated as the college junior in either engineering 
school or psychology, would probably serve a far more useful and realistic 
function. 


Seasonal Fluctuations in Employment in the Women’s Clothing Industry in New 
York. Gerirud Berta Greig. New York: Columbia University Press, 1949. Pp. 
164. $2.75. 


REVIEW BY LAZARE TEPER 


Director, Research Department, International Ladies Garment 
Workers’ Union, 1710 Broadway, New York 19, N. Y. 


_ monograph is an attempt to contribute to the understanding of 
seasonal unemployment in the New York women’s garment industry, or 
more specifically in the manufacturing of dresses wholesaled by the unit. To 
this end, the author first reviews the overall employment patterns in the 
women’s clothing industry, follows it by a discussion of the 1945 employ- 
ment fluctuations in the New York City dress trade and concludes with a 
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review of job-to-job mobility of a small group of dressmakers in the 1943— 
1945 period. 

As a statistical investigation, Miss Greig’s volume leaves much to be de- 
sired. The reader will be perturbed by minor things: index number tables 
with no base year designations, graphs improperly plotted, some obvious 
errors in the text and tables, loose use of the term “seasonal index,” some- 
times applied to indices of seasonal variations, at others to raw data. Look- 
ing further, one finds little in the study that is novel or particularly revealing 
of the author’s stated purpose. Too much of the volume consists of descrip- 
tions of statistical tables and charts based on visual inspections, too little 
space is devoted to analysis of the phenomenon, its causation, or the remedial 
measures. Even when, over a period of time, changes in employment patterns 
become noticeable (as might have been expected by the author in view of 
the different character of employment fluctuations in the separate branches 
of the industry, which have different rates of growth), she prefers to sweep 
them aside (cf. p. 35). 

The choice of 1945 as the year for study of employment fluctuations in 
the New York dress industry was not a happy one, since the war brought 
about a considerable degree of business stability in this industry. To a large 
degree, therefore, differences in employment patterns between manufactur- 
ing and contracting shops, and between establishments producing garments 
in different price ranges, remained obscure. The investigation of these pat- 
terns follows conventional lines previously exploited by others, and no at- 
tempt is made to make other significant breakdowns not previously scruti- 
nized. Thus, for example, no attempt is made to discover the differences in 
employment patterns in firms producing specialized types of dresses, classi- 
fied either by end use of the product or the type of consumers they aim to 
serve. In view of the dissatisfaction expressed by Miss Greig, elsewhere in 
her study, with global figures on seasonal variations, it is rather regrettable 
that she did not attempt to study the dispersion of employment patterns of 
the separate firms. Such an undertaking would have been in keeping with the 
avowed purposes of her inquiry and would have shed light on the problems 
facing the unemployed workers. 

The study of dress worker mobility, based on records of the New York 
State Division of Placement and Unemployment Insurance, is one of the 
bright spots of the entire volume. The use of such administrative data may 
well be emulated by other students of the labor market. The existence of low 
labor mobility raises several interesting questions. What are the character- 
istics of the group which shows higher than average mobility? In which way 
do workers in this group otherwise differ from their fellow workers? Are they, 
for example, the more enterprising element, seeking to improve their status, 
or do they have difficulties in holding jobs because they cast their nets much 
too widely? We do not know. 

It is rather unfortunate that the scope of this study, written as a doctoral 
dissertation, was so broadly conceived that its author, under the pressure of 
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time, could not treat any single topic in an exhaustive manner. A much 
better product would have come from Miss Greig’s pen had her inquiry been 
more limited in scope or if time had permitted. 


Statistical Techniques in Market Research. Robert Ferber (Research Assistant 
Professor, Bureau of Economic and Business Research, University of Illinois). 
New York: McGraw-Hill Book Company, Inc., 1949. Pp. xiv, 542. $6.00. 


Review By MELVILLE J. ULMER 


Assistant Chief, Current Business Analysis Division, U. S. 
Department of Commerce, Adjunct Professor of Economics, 
American University 


HIs is a lucid account of many of the most important techniques required 

in the collection and analysis of data for marketing research. It is written 
at the elementary level and requires of the reader no mathematical back- 
ground beyond college algebra—and not much of that. 

Somewhat more than half of the book, excluding appendices, is devoted to 
a nontechnical discussion of the logic of sampling theory and its applications. 
This allows a much more comprehensive presentation of some topics (such as 
testing of hypotheses and problems of sampling precision) than the usual 
elementary text provides, and the inclusion of certain other topics (such as 
sequential analysis and an appraisal of area and quota sampling) which are 
ordinarily omitted. In these passages Mr. Ferber is eminently successful in 
illuminating ideas which heretofore have been inaccessible to the general 
reader. 

Tests of significance, including chi square and variance analysis, are pre- 
sented in some detail and applied to problems which bear an interesting re- 
semblance to those encountered by marketing analysts. The description of 
correlation techniques follows the pattern customary at this level of presen- 
tation but deviates to include the standard error of a forecast and applica- 
tion of variance analysis to correlation problems. 

Thus strenuous—and, in the reviewer’s opinion, generally successful— 
efforts were made to direct content away from the usual format and toward 
achievement of the book’s explicit objective of providing instruction in the 
statistical techniques most important for marketing research. Nevertheless, 
two limitations in this connection may be noted. 

Discussion of the principal descriptive constants of a frequency distribu- 
tion is limited to 23 pages. This provides a convenient review for students 
with some previous knowledge of statistics, but would probably prove an 
inadequate foundation for beginners. The decision to exclude such topics as 
measures of seasonal variation and index numbers lends further weight to 
the opinion that this book can be most profitably employed for students who 
have already had the advantage of a standard one-semester introduction to 
the fundamentals of business statistics. 

In addition, from the standpoint of use by marketing analysts (as well as 
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by economists), it is unfortunate that virtually no attention is given to the 
special problems involved in correlating time series. The closest the author 
comes to this phase of the subject is to present measures of serial correlation; 
even here comment is confined to the too simple dictum that when measures 
of serial correlation are high “most analytical tools are invalidated.” 

Appendices include an extensive and conveniently classified bibliography, 
a few mathematical derivations, and an unusually full complement of refer- 
ence tables. 

How useful this text is found in the classroom depends directly upon the 
nature of the specific educational program in which it is assigned a role. It is 
essentially a recipe book which provides answers elucidated with unusual 
clarity, but furnishes little training in the principles from which these an- 
swers are derived. As such, it cannot prepare the student to solve statistical 
problems independently or even to appraise the made-to-order solutions 
with which he has been equipped. As an introduction to more advanced work 
in statistics, therefore, it is wasteful—a remark which should be construed 
not as criticism of Mr. Ferber’s excellent work but rather as a limitation in- 
herent in this level of presentation. In the same category may be placed the 
occasiona’ compromises with strict accuracy of concept which are encoun- 
tered in this book. 

On the other hand, for students who plan to engage in marketing research 
and who lack the time or inclination for the mathematical training essential 
for specialization in statistics, this text will prove illuminating, practical, 
and superior to any directly competitive product now available. It is useful 
likewise as a reference work for practicing marketing analysts. 


Historical Statistics of the United States, 1789-1945. A Supplement to the Statisti- 
cal Abstract of the United States. Washington, 1949. Government Printing 
Office, Washington D.C. 


Review BY W. S. WoyTInsky 
The Johns Hopkins University 


His is a new type of statistical source book designed to serve two imme- 

diate needs: to bring together historical series of wide general interest, 
covering various periods from 1789 to 1945, and to provide a guide to the 
sources of further historical data for the United States. 

The introduction stresses that the first edition “is not intended as a final 
product. In terms of the objectives of the compilers, it is preliminary in 
character and comprises, in effect, a working manuscript. As such, it estab- 
lishes a pattern and provides a preliminary selection of materials. Gaps and 
weaknesses are therefore disclosed and problems crystallized. On the basis of 
the experience thus gained, and the suggestions and criticisms of users of this 
edition, the process of revision will make possible a more useful future edi- 
tion.” 

This generous invitation to criticism is qualified to some extent by the 
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following remark: “Major objectives of a future revision of this volume 
should include presentation of additional series less readily available, a se- 
lection of some of the more significant lapsed (discontinued) series which 
offer light on early American history, and series in a few additional subject 
fields for which statistics could not be presented in this first edition.” 

The present reviewer takes the liberty of offering suggestions that go be- 
yond these “major objectives.” He feels that the excellent results of the first 
experiment justify further experiment on a much larger scale. 

It would be difficult to improve appreciably the present collection of his- 
torical statistics within its present scope of approximately 3,000 series. On 
the other hand, an extensive check of the content of each chapter of the vol- 
ume leads to the conclusion that the present scope of the selection is too nar- 
row, so that many users will not find in this collection the historical data for 
which they are looking. 

The most striking gap in the historical series offered is that they are lim- 
ited to national totals, without break by state. The cause of this limitation 
is obvious: Each time national totals are supplemented by state data, a sin- 
gle line in a table must be replaced by a full page of figures. To cover four 
score topics in this way would require not less than a hundred pages of addi- 
tional tables and explanatory notes. On the other hand, in many statistical 
series, state and regional data are at least as important as national totals. 
Indeed, most users of historical statistics are more likely to look for state 
and regional data than for national totals. This is particularly true of educa- 
tional institutions and businessmen who will use the collection. It seems, 
therefore, that the following state tables should be included in the series: 
Population data classified by sex, urban-rural residence and race (this addi- 
tion would require a dozen pages of tables to replace Series B48-71 on p. 
27); population by urban-size groups; internal migration; foreign-born popu- 
lation by country of birth; a time series showing density of population; 
health-hospital facilities (the present Series C104—117); industrial and oc- 
cupational distribution of gainful workers classified by sex; distribution 
of farms, farm labor, livestock and crops by state (this also would require at 
least a dozen pages of tables); forests and cut of timber; mines and mineral 
products; factories and manufacturing production (2-digit classification). 

The topics listed here are closely interrelated. There would be little point 
in giving historical statistics by state for one subject and nothing but national 
totals for the others. When a new edition is planned—and we hope that it 
will be prepared soon enough to bring it on the market early in 1952—a 
general decision should be made whether the historical trends in the United 
States should be portrayed by national totals or presented as a three-dimen- 
sional picture, by state and region. It seems that the latter type of presenta- 
tion would ensure new outlets and additional users for the publication. 

The value of the collection would be further increased by inclusion of 4 
few tables for large cities—perhaps 12 to 20 additional pages. 

Another gap in the present collection of historical statistics is the scarcity 
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or lack of analytical tables. The reading public in this country is fond of 
statistics but likes to get them in a handy and easily digestible form. A lay- 
man understands percentages and averages better than original figures. 
While not all statistics can be presented in such a way, at least a few key 
tables in each chapter could be arranged for the benefit of lay users. For 
example, the trends in national income could be illustrated by per capita 
figures adjusted to prices (applying to official data after 1929 the procedure 
used in the series of the National Industrial Conference Board); the dis- 
tribution of national income by industrial origin and its structure by dis- 
tributive shares could be shown in percentages; the number of physicians 
and hospital facilities could be given in relation to the population; the num- 
ber of factory workers and the volume of manufacturing output could be pre- 
sented for each state, as a percentage of national total, and so on. 

Following the same line of reasoning, the present reviewer would recom- 
mend a broad use of charts and maps of the type used now in the Statistical 
Abstract, Minerals Yearbook, publications of the Department of Agriculture 
and so on. At least two pages of carefully selected charts and maps of various 
types (in order to avoid excessive uniformity) could be added to each chapter. 
This, again, is a general question of presentation: there would be no point in 
inserting in the collection a dozen charts picked up at random; if illustrative 
material is included, it should be utilized systematically as an important part 
of the publication. The reviewer believes that a combination of analytical 
tables, charts and maps would make the whole collection more readable and 
attractive for laymen for whom the present publication may prove indigest- 
ible. 

Some additional special topics should be included—per capita income by 
state, distribution of factories and farms by size, trends in the financial status 
of farmers, union membership by industry, imports and exports by country, 
cross-classifications of certain articles of import and export by country of 
origin or destination; and so on. 

To sum up, this reviewer recommends that the volume be doubled or more 
than doubled in size and redesigned for a much broader circle of users, and 
that this new enlarged edition be prepared as soon as the 1950 Census data 
become available. 


Proceedings of the Berkeley Symposium on Mathematical Statistics and 
Probability. Edited by Jerzy Neyman (Director of the Statistical Laboratory, 
University of California). Berkeley and Los Angeles: University of California 
Press, 1949. Pp. 501. $7.50. 


Review sy C. C. Crara 
Professor of Mathematics and Director of the Statistical Research 
Laboratory, The University of Michigan, 
Ann Arbor, Michigan 


¢~ fairly large volume contains twenty-nine papers which were delivered 
in the two sessions of the symposium held in Berkeley in August, 1945 and 
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January, 1946. Professor Neyman states in his brief “Foreword” that his 
purpose in organizing this symposium was “to mark” (for statisticians) 
“the end of the war and to stimulate the return to theoretical research.” It 
seems to the reviewer that as a whole the papers herein published serve those 
ends well. 

Without strict accuracy in every case, these papers can be grouped into 
five categories: foundations of the theory of probability, mathematical prob- 
ability, mathematical statistics, applications, and the teaching of statistics; 
and they will be discussed in this order, necessarily rather briefly. 

In the first category are papers by Hans Reichenbach and A. H. Copeland. 
The first of these is an excellently written brief account of the author’s sys- 
tematic examination and formulation of a basis in logic on which a science of 
mathematical statistics can be built, keeping constantly in view its appli- 
cability to physical phenomena. A previous acquaintance with the calculus 
of probability and with the ideas of other writers, to which frequent refer- 
ences are made, will be helpful but a reading and rereading of this article 
will repay any statistician who wishes to gain a better understanding of the 
foundations on which his subject rests. The second of these papers is much 
more technical in character. By means of a long list of definitions, postulates, 
and theorems the author builds up a formal calculus of probability incorpo- 
rating the features now customarily included. What advantages this formu- 
lation may have for applicability or further investigations in theoretical 
statistics are not discussed. 

George Pélya’s short but instructive paper on characteristic functions is 
the first of three on mathematical probability. This is in two parts, one ona 
simple sufficient condition that a function be a characteristic function of a 
continuous distribution function with an interesting remark on the divisi- 
bility of distribution functions, and the other on the specification of dis- 
tributions defined over a finite range only by means of characteristic func- 
tions. 

The second, by J. L. Doob, is necessarily much longer even though it pre- 
sents a compact outline of the formulation and treatment the mathematicians 
have developed during the last twenty years for the analysis of a time series 
into its component periodicities. Many statisticians, also interested in the 
same problem, have hardly been aware of this work, but they will find that to 
read an account of it, a very considerable degree of mathematical sophistica- 
tion is required. But the analysis of a time series is a mathematical problem. 
If one conceives that the distribution law for a random variable observed 
at time ¢ depends on ¢ and then tries to describe the behavior of such a vari- 
able in time by a composition of simple cycles, a rigorous attack with all 
available mathematical tools leads to the work Professor Doob describes so 
authoritatively, in part because he has contributed much to it. The theory 
is illustrated by a number of important examples, particularly interesting 
ones being drawn from physics. 
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The third paper in this group, by Will Feller on stochastic processes and 
applications, also richly justifies its comparative length because it is a very 
lucid and readable introduction to the theory of random processes of the 
Markov type with a continuous time parameter in which the state of the 
system changes by jumps. The author begins with the simplest cases and 
keeps constantly to the fore the applications to growth theory, population 
dynamics, telephone engineering, physics, and insurance, among others, 
which have guided the development of much of the theory, and shows how 
these problems are handled. Transition probabilities of increasingly more 
general type are introduced as their need is shown and more advanced meth- 
ods, to which Professor Feller has been a chief contributor, are required. 
Some of the problems so arising are new and some new results are here stated. 
A reader with some knowledge of mathematical statistics but lacking knowl- 
edge of this important and fascinating field will find the article valuable. 

Some ten papers seem to fall in the category of mathematical statistics. A 
second paper by George Pélya is concerned with means of computing the 
normal probability integral and in the two dimensional case he derives two 
inequalities and a divergent enveloping series that were useful in extending 
the table of volumes under the normal correlation surface in Karl Pearson’s 
Tables for Statisticians and Biometricians. Evelyn Fix gives, under weaker 
assumptions than used before, necessary and sufficient conditions that 
af +a and b§ +8 have linear regressions on each other, £, a, and 8 being mu- 
tually independent random variables and a and 6b unknown constants—a 
problem originally proposed by Ragnar Frisch. Jacob Wolfowitz’s largely 
expository article is a well-written and informative account of some of the 
recent developments in the field of non-parametric statistical inference, i.e., 
the means of valid inferences from samples drawn from universes with dis- 
tribution laws of unknown form. He includes one new result, the large sam- 
ple variance of the number of runs in a set of observations drawn from two 
different universes. 

Jerzy Neyman considers a class of estimates of parameters from samples 
drawn from universes with distribution laws of known form, which have, as 
the sample size increases, the same properties of consistency, asymptotic 
normality, and minimal variance possessed by maximum likelihood (MLZ) 
estimates. These, termed “best asymptotically normal” (BAN), are investi- 
gated in the hope that some of them will prove to be more readily computed 
than ML estimates. One theorem determines two tests of the x? type which 
are consistent and in the limit equivalent to likelihood ratio tests and which 
for application require the calculation of BAN tests which, it is shown, can 
frequently be reduced to the solution of linear equations. This is a further 
development of an important line of Professor Neyman’s research. 

Harold Hotelling reviews the three main types of matrix calculations 
needed for applications which, he points out, include a wide range of prob- 
lems in varied fields. Mechanical and electrical devices for carrying out such 
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computations, iterative methods and the control of errors, and the device 
of partitioning large matrices are discussed. Finally he considers the possi- 
bility of constructing a useful table of inverses of matrices. 

Suppose two normal universes are known by means of randomly drawn 
samples from each of them and it is desired to test the hypothesis that an- 
other observation known to come from one of the universes came from a par- 
ticular one. C. F. Kossack deals with this problem along lines laid down by 
Wald, who considered the multivariate case with equal universe covariance 
matrices, in the one dimensional situations of equal universe means, equal 
variances, and unequal means and variances. A. T. Lonseth is concerned 
with an algorithm, used by Hotelling for the approximation to the inverse 
of a matrix, in its more general mathematical form. He finds a bound for the 
error committed by its use which is a generalization of one due to Hotelling 
and discusses applications not only to matrices but also to certain linear 
integral equations. P. L. Hsu generalizes a theorem of Doob on the large 
sample distribution of functions of sample means, applying his results to a 
lengthy list of known test criteria, and illustrating their use in testing a cor- 
respondingly varied set of statistical hypotheses in multivariate sampling 
theory. E. W. Barankin extends the solution given by H. Scheffé for the 
Behrens-Fisher problem to the following: Suppose that z and y are random 
normally distributed variables with variances o;* and o2? and means given by 
the regressions zt =h, +k,£ and y =h2+he£ in which Ai, he, ki, k2 are constants 
and £ is a random variable measurable without error. Without assuming that 
o;? =0;7, we wish to test the hypothesis that k, =k2. Finally, speaking a bit 
loosely, of the tests for which the risk of rejecting a true hypothesis (the sig- 
nificance level) is the same, one is (or several are) said to be asymptotically 
most powerful (A MP) if, as the sample size increases indefinitely, its (their) 
chance of rejecting any false hypothesis (the power) is not less than that of 
any other test. E. L. Lehmann constructs two examples to illustrate the fact 
that a particular test which has this very desirable property for large sam- 
ples does not have to be either relatively or absolutely a very good test for 
small samples. 

The papers of the last group, thirteen in all, either give accounts of the use 
of statistical methods in research in a number of fields or describe problems 
in which the assistance of mathematical statisticians is needed. 

V. F. Lenzen interestingly reviews the development of statistical mechan- 
ics from its beginnings, through the stage in which the principles of classical 
mechanics were applied, to the forms of the theory resulting from the impact 
of quantum mechanics and later from the introduction of wave mechanics. 
Egon Brunswik’s paper on experimentation in psychology seems !ong and 
prolix to its own detriment. Its principal point, elaborated with much dis- 
cussion and a variety of examples, is the growing realization on the part of 
psychologists of the applicability and value of statistical methods in both 
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the design and interpretation of their experiments. F. W. Dresch, in a paper 
somewhat technical mathematically, sets up index numbers for both prices 
and volumes of production of the continuous type of Divisia for classes of 
goods and shows how they can be utilized in the classical theory of prices 
and production. Francis Bitter is concerned that mathematicians apply 
their talents to the formulation and analysis of strategic problems in total 
warfare and outlines some games which are greatly simplified models of 
actual problems whose analysis may nevertheless be instructive. G. M. Mc- 
Ewen explains the application of the analysis of variance to the search for 
periodicities. R. J. Trumpler outlines quite clearly the problem of determin- 
ing the distribution of stars in space with respect to position, velocity, spec- 
tral class and absolute magnitude. Briefly, but very well, he describes the 
difficulties and the methods used, especially for the main problem of finding 
the distribution of distances from star counts made according to apparent 
magnitudes. 

Of the remaining seven papers in this section six are descriptive in charac- 
ter, all describing problems and experiments in which statistical aid is asked. 
S. N. Wyckoff writes of the study of methods of management of forest and 
grazing areas and the conservation of water resources in California. A. L. 
Hormay and J. R. Bentley tell of an experiment designed to test the effects 
of intensity of grazing on cattle grazing areas. E. L. Hamilton’s problem 
is getting better data in the sampling of rainfall in mountainous areas. A. A. 
Hasel describes the design of a long-term experiment now in progress on 
methods of harvesting timber. E. R. Dempster and I. M. Lerner propose an 
experiment on rats to throw light on the supposition that natural mutations 
occur continuously and frequently but with such small effects that they are 
ordinarily overlooked. J. K. Holloway discusses some of the problems that 
arise in determining the effectiveness of the introduction of insect predators 
and parasites in controlling three varieties of scale. G. A. Baker and F. N. 
Briggs are concerned with the inheritance of resistance to bunt in wheat. 
The particular problem has to do with distinguishing the genotypes with 
respect to resistance in the F; generation. This is done by observing the be- 
havior in rows in F; plants, and in the case of a single dominant factor for 
resistance mathematical models are set up for use in the study of the vari- 
ability to be expected. 

Finally, Harold Hotelling writes on the place of statistics in a university. 
As many readers will know, he has already taken the lead in discussions of 
this subject and in vigorously advancing views generally supported by mathe- 
matical statisticians. He here examines the varied aspects of this matter in a 
thorough and authoritative manner, as his achievements and experience en- 
title him to do; and all students, teachers, researchers, and administrators in 
our universities who have to do with statistics should become well acquainted 
with what Professor Hotelling has to say. 





- 


308 AMERICAN STATISTICAL ASSOCIATION JOURNAL, JUNE 1950 


National Transportation Policy. Charles L. Dearing and Wilfred Owen. Washing- 
ton 6, D.C.: The Brookings Institution, 1949. Pp. xiv, 459. $4.00. 


Review BY Paut H. ANDERSON 


Associate Chief, Program Control Branch, Transportation Corps, 
Department of the Army, Washington, D. C. 


_= study is a careful review of the role of the federal government in the 
field of transportation. Specific attention is devoted to the problem of 
expanding the transportation facilities of the nation as well as to the regula- 
tion and policy of the government with regard to various aspects of this 
strategic industry. 

Dearing and Owen recommend the establishment of a Department of 
Transportation headed by a Secretary with cabinet status. Within the De- 
partment, there is further suggested a program of transportation research 
and planning to be conducted by the Undersecretary’s Office. The research 
program would be concerned, in part, with a nui:ber of technical problems 
requiring the use of statistical data and techniques. Problems of this type 
relate to (1) the determination of civilian transportation requirements and 
capacities; (2) the evaluation of all programs which are intended to achieve 
the most effective peacetime transportation system at the lowest cost; (3) 
the development of plans and techniques for the operation of the transporta- 
tion system in time of war; (4) the evaluation of methods for financing trans- 
portation facilities through user charges; and (5) the problem of passenger 
safety. 

The book’s logically arranged and clearly written contents will be of inter- 
est, not only to transportation specialists, but also to economists and admin- 
istrators. For statisticians primarily interested in the transportation field this 
study should be of value, particularly Part III which discusses the proposed 
revision of national transportation policy. 


ERRATUM 


The price of Palmer O. Johnson’s Statistical Methods in Research is given 
erroneously on page 570 of the December, 1949 issue (vol. 44, no. 248). The 
correct college list price is $5.00. 
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